2023-09-24 20:00:33,548 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-24 20:00:33,775 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564 2023-09-24 20:00:33,775 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-24 20:00:33,776 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-24 20:00:33,812 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-24 20:00:34,039 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-24 20:00:34,039 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76, deleteOnExit=true 2023-09-24 20:00:34,039 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-24 20:00:34,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/test.cache.data in system properties and HBase conf 2023-09-24 20:00:34,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 20:00:34,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop.log.dir in system properties and HBase conf 2023-09-24 20:00:34,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 20:00:34,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 20:00:34,041 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 20:00:34,361 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-24 20:00:34,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 20:00:34,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 20:00:34,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 20:00:34,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 20:00:34,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 20:00:34,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 20:00:34,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 20:00:34,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 20:00:34,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 20:00:34,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/nfs.dump.dir in system properties and HBase conf 2023-09-24 20:00:34,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir in system properties and HBase conf 2023-09-24 20:00:34,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 20:00:34,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 20:00:34,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-24 20:00:34,887 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 20:00:34,892 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 20:00:35,232 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-24 20:00:35,414 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-24 20:00:35,433 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:35,486 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:35,521 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_localhost_42821_hdfs____.c7z76l/webapp 2023-09-24 20:00:35,682 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42821 2023-09-24 20:00:35,694 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 20:00:35,694 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 20:00:36,262 WARN [Listener at localhost/32847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 20:00:36,336 WARN [Listener at localhost/32847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 20:00:36,357 WARN [Listener at localhost/32847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:36,365 INFO [Listener at localhost/32847] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:36,371 INFO [Listener at localhost/32847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_localhost_42283_datanode____.zbsw16/webapp 2023-09-24 20:00:36,509 INFO [Listener at localhost/32847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42283 2023-09-24 20:00:36,922 WARN [Listener at localhost/44217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 20:00:36,941 WARN [Listener at localhost/44217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 20:00:36,945 WARN [Listener at localhost/44217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:36,948 INFO [Listener at localhost/44217] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:36,959 INFO [Listener at localhost/44217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_localhost_34357_datanode____r1h4aj/webapp 2023-09-24 20:00:37,073 INFO [Listener at localhost/44217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34357 2023-09-24 20:00:37,089 WARN [Listener at localhost/34983] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 20:00:37,110 WARN [Listener at localhost/34983] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 20:00:37,117 WARN [Listener at localhost/34983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:37,119 INFO [Listener at localhost/34983] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:37,129 INFO [Listener at localhost/34983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_localhost_35889_datanode____.xla39e/webapp 2023-09-24 20:00:37,272 INFO [Listener at localhost/34983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35889 2023-09-24 20:00:37,282 WARN [Listener at localhost/45415] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 20:00:37,561 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf39aafa28f1c5c35: Processing first storage report for DS-36a5f421-a5f2-47d8-828d-52e4d68be574 from datanode beb225ef-6a1c-4708-90ba-41c43fc96ac8 2023-09-24 20:00:37,563 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf39aafa28f1c5c35: from storage DS-36a5f421-a5f2-47d8-828d-52e4d68be574 node DatanodeRegistration(127.0.0.1:43251, datanodeUuid=beb225ef-6a1c-4708-90ba-41c43fc96ac8, infoPort=42445, infoSecurePort=0, ipcPort=34983, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c71e512a48be2f6: Processing first storage report for DS-720b468e-a65c-43a0-84a0-29d47a33d815 from datanode e348408b-80e7-41be-b97e-b943648a5ad8 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c71e512a48be2f6: from storage DS-720b468e-a65c-43a0-84a0-29d47a33d815 node DatanodeRegistration(127.0.0.1:41473, datanodeUuid=e348408b-80e7-41be-b97e-b943648a5ad8, infoPort=42433, infoSecurePort=0, ipcPort=45415, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x91810d16ec885ff4: Processing first storage report for DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b from datanode a50f88cb-e068-41a0-995f-2842fe84f1a0 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x91810d16ec885ff4: from storage DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b node DatanodeRegistration(127.0.0.1:36525, datanodeUuid=a50f88cb-e068-41a0-995f-2842fe84f1a0, infoPort=41137, infoSecurePort=0, ipcPort=44217, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf39aafa28f1c5c35: Processing first storage report for DS-09233e3a-6fd3-4676-95bb-311a8c3d0bc7 from datanode beb225ef-6a1c-4708-90ba-41c43fc96ac8 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf39aafa28f1c5c35: from storage DS-09233e3a-6fd3-4676-95bb-311a8c3d0bc7 node DatanodeRegistration(127.0.0.1:43251, datanodeUuid=beb225ef-6a1c-4708-90ba-41c43fc96ac8, infoPort=42445, infoSecurePort=0, ipcPort=34983, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c71e512a48be2f6: Processing first storage report for DS-6e9f09ae-9770-4ced-8ba7-afbfc9f26b8e from datanode e348408b-80e7-41be-b97e-b943648a5ad8 2023-09-24 20:00:37,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c71e512a48be2f6: from storage DS-6e9f09ae-9770-4ced-8ba7-afbfc9f26b8e node DatanodeRegistration(127.0.0.1:41473, datanodeUuid=e348408b-80e7-41be-b97e-b943648a5ad8, infoPort=42433, infoSecurePort=0, ipcPort=45415, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,565 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x91810d16ec885ff4: Processing first storage report for DS-7f5ee8be-c9f5-4ea9-aa2c-046528fd81fe from datanode a50f88cb-e068-41a0-995f-2842fe84f1a0 2023-09-24 20:00:37,565 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x91810d16ec885ff4: from storage DS-7f5ee8be-c9f5-4ea9-aa2c-046528fd81fe node DatanodeRegistration(127.0.0.1:36525, datanodeUuid=a50f88cb-e068-41a0-995f-2842fe84f1a0, infoPort=41137, infoSecurePort=0, ipcPort=44217, storageInfo=lv=-57;cid=testClusterID;nsid=531080683;c=1695585635003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 20:00:37,791 DEBUG [Listener at localhost/45415] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564 2023-09-24 20:00:37,889 INFO [Listener at localhost/45415] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/zookeeper_0, clientPort=61864, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-24 20:00:37,909 INFO [Listener at localhost/45415] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61864 2023-09-24 20:00:37,920 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:37,922 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:38,654 INFO [Listener at localhost/45415] util.FSUtils(471): Created version file at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 with version=8 2023-09-24 20:00:38,655 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/hbase-staging 2023-09-24 20:00:39,039 INFO [Listener at localhost/45415] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-24 20:00:39,538 INFO [Listener at localhost/45415] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 20:00:39,571 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:39,572 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:39,572 INFO [Listener at localhost/45415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 20:00:39,572 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:39,572 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 20:00:39,718 INFO [Listener at localhost/45415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 20:00:39,799 DEBUG [Listener at localhost/45415] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-24 20:00:39,894 INFO [Listener at localhost/45415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40043 2023-09-24 20:00:39,907 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:39,909 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:39,932 INFO [Listener at localhost/45415] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40043 connecting to ZooKeeper ensemble=127.0.0.1:61864 2023-09-24 20:00:39,985 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:400430x0, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 20:00:39,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40043-0x100df86cd910000 connected 2023-09-24 20:00:40,022 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 20:00:40,023 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:00:40,042 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 20:00:40,054 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40043 2023-09-24 20:00:40,055 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40043 2023-09-24 20:00:40,061 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40043 2023-09-24 20:00:40,061 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40043 2023-09-24 20:00:40,062 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40043 2023-09-24 20:00:40,068 INFO [Listener at localhost/45415] master.HMaster(444): hbase.rootdir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, hbase.cluster.distributed=false 2023-09-24 20:00:40,137 INFO [Listener at localhost/45415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 20:00:40,138 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,138 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,138 INFO [Listener at localhost/45415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 20:00:40,138 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,138 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 20:00:40,143 INFO [Listener at localhost/45415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 20:00:40,147 INFO [Listener at localhost/45415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37535 2023-09-24 20:00:40,150 INFO [Listener at localhost/45415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 20:00:40,157 INFO [Listener at localhost/45415] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 20:00:40,158 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,161 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,164 INFO [Listener at localhost/45415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37535 connecting to ZooKeeper ensemble=127.0.0.1:61864 2023-09-24 20:00:40,169 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:375350x0, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 20:00:40,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37535-0x100df86cd910001 connected 2023-09-24 20:00:40,170 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 20:00:40,172 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:00:40,173 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 20:00:40,177 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37535 2023-09-24 20:00:40,178 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37535 2023-09-24 20:00:40,178 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37535 2023-09-24 20:00:40,181 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37535 2023-09-24 20:00:40,184 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37535 2023-09-24 20:00:40,197 INFO [Listener at localhost/45415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 20:00:40,198 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,198 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,199 INFO [Listener at localhost/45415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 20:00:40,199 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,199 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 20:00:40,199 INFO [Listener at localhost/45415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 20:00:40,201 INFO [Listener at localhost/45415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46007 2023-09-24 20:00:40,202 INFO [Listener at localhost/45415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 20:00:40,203 INFO [Listener at localhost/45415] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 20:00:40,204 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,206 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,210 INFO [Listener at localhost/45415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46007 connecting to ZooKeeper ensemble=127.0.0.1:61864 2023-09-24 20:00:40,214 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:460070x0, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 20:00:40,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46007-0x100df86cd910002 connected 2023-09-24 20:00:40,215 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 20:00:40,216 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:00:40,216 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 20:00:40,221 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46007 2023-09-24 20:00:40,221 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46007 2023-09-24 20:00:40,221 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46007 2023-09-24 20:00:40,225 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46007 2023-09-24 20:00:40,225 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46007 2023-09-24 20:00:40,237 INFO [Listener at localhost/45415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 20:00:40,238 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,238 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,238 INFO [Listener at localhost/45415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 20:00:40,238 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 20:00:40,239 INFO [Listener at localhost/45415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 20:00:40,239 INFO [Listener at localhost/45415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 20:00:40,240 INFO [Listener at localhost/45415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43375 2023-09-24 20:00:40,241 INFO [Listener at localhost/45415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 20:00:40,242 INFO [Listener at localhost/45415] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 20:00:40,243 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,244 INFO [Listener at localhost/45415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,246 INFO [Listener at localhost/45415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43375 connecting to ZooKeeper ensemble=127.0.0.1:61864 2023-09-24 20:00:40,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:433750x0, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 20:00:40,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43375-0x100df86cd910003 connected 2023-09-24 20:00:40,250 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 20:00:40,251 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:00:40,251 DEBUG [Listener at localhost/45415] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 20:00:40,256 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43375 2023-09-24 20:00:40,256 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43375 2023-09-24 20:00:40,257 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43375 2023-09-24 20:00:40,257 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43375 2023-09-24 20:00:40,258 DEBUG [Listener at localhost/45415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43375 2023-09-24 20:00:40,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:40,272 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 20:00:40,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:40,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 20:00:40,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 20:00:40,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 20:00:40,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 20:00:40,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:40,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 20:00:40,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40043,1695585638864 from backup master directory 2023-09-24 20:00:40,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 20:00:40,302 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:40,302 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 20:00:40,303 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 20:00:40,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:40,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-24 20:00:40,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-24 20:00:40,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/hbase.id with ID: f3b03a51-020a-4b21-ab3c-e7ad5dd85d6b 2023-09-24 20:00:40,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 20:00:40,476 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:40,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x401a1cb9 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:40,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e1f328, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:40,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 20:00:40,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-24 20:00:40,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-24 20:00:40,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-24 20:00:40,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 20:00:40,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 20:00:40,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 20:00:40,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store-tmp 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 20:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:00:40,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:00:40,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 20:00:40,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/WALs/jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:40,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40043%2C1695585638864, suffix=, logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/WALs/jenkins-hbase4.apache.org,40043,1695585638864, archiveDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/oldWALs, maxLogs=10 2023-09-24 20:00:40,794 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK] 2023-09-24 20:00:40,794 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK] 2023-09-24 20:00:40,794 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK] 2023-09-24 20:00:40,804 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-24 20:00:40,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/WALs/jenkins-hbase4.apache.org,40043,1695585638864/jenkins-hbase4.apache.org%2C40043%2C1695585638864.1695585640741 2023-09-24 20:00:40,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK], DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK], DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK]] 2023-09-24 20:00:40,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-24 20:00:40,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:40,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:40,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:40,950 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:40,959 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-24 20:00:40,998 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-24 20:00:41,013 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:41,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:41,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:41,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 20:00:41,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:41,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66595415, jitterRate=-0.007650986313819885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:00:41,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 20:00:41,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-24 20:00:41,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-24 20:00:41,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-24 20:00:41,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-24 20:00:41,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-24 20:00:41,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-24 20:00:41,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-24 20:00:41,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-24 20:00:41,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-24 20:00:41,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-24 20:00:41,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-24 20:00:41,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-24 20:00:41,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-24 20:00:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-24 20:00:41,189 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:41,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-24 20:00:41,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-24 20:00:41,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-24 20:00:41,210 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 20:00:41,210 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 20:00:41,210 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 20:00:41,210 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:41,210 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 20:00:41,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40043,1695585638864, sessionid=0x100df86cd910000, setting cluster-up flag (Was=false) 2023-09-24 20:00:41,228 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:41,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-24 20:00:41,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:41,243 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:41,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-24 20:00:41,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:41,254 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp 2023-09-24 20:00:41,263 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(951): ClusterId : f3b03a51-020a-4b21-ab3c-e7ad5dd85d6b 2023-09-24 20:00:41,263 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(951): ClusterId : f3b03a51-020a-4b21-ab3c-e7ad5dd85d6b 2023-09-24 20:00:41,264 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(951): ClusterId : f3b03a51-020a-4b21-ab3c-e7ad5dd85d6b 2023-09-24 20:00:41,269 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 20:00:41,269 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 20:00:41,269 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 20:00:41,279 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 20:00:41,279 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 20:00:41,279 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 20:00:41,279 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 20:00:41,279 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 20:00:41,279 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 20:00:41,283 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 20:00:41,283 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 20:00:41,283 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 20:00:41,286 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ReadOnlyZKClient(139): Connect 0x7e8c7836 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:41,287 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbcce64 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:41,287 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ReadOnlyZKClient(139): Connect 0x3ea5fd02 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:41,322 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@704b9997, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:41,323 DEBUG [RS:2;jenkins-hbase4:43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@306214a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:41,323 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74741346, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 20:00:41,323 DEBUG [RS:0;jenkins-hbase4:37535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@137b33a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:41,323 DEBUG [RS:2;jenkins-hbase4:43375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@345d9672, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 20:00:41,323 DEBUG [RS:0;jenkins-hbase4:37535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1744a514, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 20:00:41,348 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46007 2023-09-24 20:00:41,348 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37535 2023-09-24 20:00:41,353 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43375 2023-09-24 20:00:41,353 INFO [RS:0;jenkins-hbase4:37535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 20:00:41,353 INFO [RS:2;jenkins-hbase4:43375] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 20:00:41,354 INFO [RS:2;jenkins-hbase4:43375] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 20:00:41,353 INFO [RS:1;jenkins-hbase4:46007] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 20:00:41,354 INFO [RS:0;jenkins-hbase4:37535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 20:00:41,354 INFO [RS:1;jenkins-hbase4:46007] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 20:00:41,385 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 20:00:41,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-24 20:00:41,385 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 20:00:41,385 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 20:00:41,387 INFO [RS:1;jenkins-hbase4:46007] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:41,387 INFO [RS:0;jenkins-hbase4:37535] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:41,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:41,387 INFO [RS:2;jenkins-hbase4:43375] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:41,388 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 20:00:41,388 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 20:00:41,388 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 20:00:41,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-24 20:00:41,392 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:46007, startcode=1695585640196 2023-09-24 20:00:41,392 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:37535, startcode=1695585640136 2023-09-24 20:00:41,392 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:43375, startcode=1695585640237 2023-09-24 20:00:41,412 DEBUG [RS:0;jenkins-hbase4:37535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 20:00:41,412 DEBUG [RS:2;jenkins-hbase4:43375] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 20:00:41,412 DEBUG [RS:1;jenkins-hbase4:46007] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 20:00:41,475 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42597, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 20:00:41,475 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42459, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 20:00:41,475 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43465, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 20:00:41,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-24 20:00:41,483 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-24 20:00:41,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,492 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 20:00:41,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 20:00:41,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,492 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 20:00:41,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695585671498 2023-09-24 20:00:41,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-24 20:00:41,506 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 20:00:41,507 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-24 20:00:41,513 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 20:00:41,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-24 20:00:41,519 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 20:00:41,519 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 20:00:41,519 WARN [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 20:00:41,519 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 20:00:41,519 WARN [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 20:00:41,520 WARN [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 20:00:41,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-24 20:00:41,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-24 20:00:41,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-24 20:00:41,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-24 20:00:41,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-24 20:00:41,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-24 20:00:41,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-24 20:00:41,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-24 20:00:41,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-24 20:00:41,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695585641530,5,FailOnTimeoutGroup] 2023-09-24 20:00:41,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695585641531,5,FailOnTimeoutGroup] 2023-09-24 20:00:41,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-24 20:00:41,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,560 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 20:00:41,561 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 20:00:41,561 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:41,583 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:41,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 20:00:41,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/info 2023-09-24 20:00:41,588 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 20:00:41,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:41,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 20:00:41,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/rep_barrier 2023-09-24 20:00:41,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 20:00:41,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:41,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 20:00:41,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/table 2023-09-24 20:00:41,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 20:00:41,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:41,598 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740 2023-09-24 20:00:41,599 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740 2023-09-24 20:00:41,603 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 20:00:41,605 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 20:00:41,609 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:41,609 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67290662, jitterRate=0.002709001302719116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 20:00:41,610 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 20:00:41,610 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 20:00:41,610 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 20:00:41,610 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 20:00:41,610 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 20:00:41,610 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 20:00:41,612 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 20:00:41,612 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 20:00:41,619 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 20:00:41,619 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-24 20:00:41,621 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:37535, startcode=1695585640136 2023-09-24 20:00:41,621 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:46007, startcode=1695585640196 2023-09-24 20:00:41,621 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40043,1695585638864 with isa=jenkins-hbase4.apache.org/172.31.14.131:43375, startcode=1695585640237 2023-09-24 20:00:41,628 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-24 20:00:41,635 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,636 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40043] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,636 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:41,636 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32847 2023-09-24 20:00:41,636 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 20:00:41,637 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:41,637 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32847 2023-09-24 20:00:41,637 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 20:00:41,638 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:41,638 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32847 2023-09-24 20:00:41,638 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 20:00:41,646 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:00:41,647 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,647 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,647 WARN [RS:2;jenkins-hbase4:43375] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 20:00:41,647 WARN [RS:1;jenkins-hbase4:46007] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 20:00:41,648 INFO [RS:2;jenkins-hbase4:43375] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 20:00:41,647 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ZKUtil(162): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,648 WARN [RS:0;jenkins-hbase4:37535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 20:00:41,648 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,648 INFO [RS:1;jenkins-hbase4:46007] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 20:00:41,649 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-24 20:00:41,650 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,650 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37535,1695585640136] 2023-09-24 20:00:41,650 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43375,1695585640237] 2023-09-24 20:00:41,650 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46007,1695585640196] 2023-09-24 20:00:41,648 INFO [RS:0;jenkins-hbase4:37535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 20:00:41,650 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,656 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-24 20:00:41,671 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,671 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,671 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ZKUtil(162): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,671 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,671 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,671 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ZKUtil(162): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,672 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,672 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ZKUtil(162): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,672 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ZKUtil(162): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,683 DEBUG [RS:0;jenkins-hbase4:37535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 20:00:41,683 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 20:00:41,683 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 20:00:41,693 INFO [RS:0;jenkins-hbase4:37535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 20:00:41,694 INFO [RS:2;jenkins-hbase4:43375] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 20:00:41,693 INFO [RS:1;jenkins-hbase4:46007] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 20:00:41,718 INFO [RS:1;jenkins-hbase4:46007] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 20:00:41,718 INFO [RS:0;jenkins-hbase4:37535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 20:00:41,718 INFO [RS:2;jenkins-hbase4:43375] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 20:00:41,723 INFO [RS:1;jenkins-hbase4:46007] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 20:00:41,723 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,723 INFO [RS:0;jenkins-hbase4:37535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 20:00:41,724 INFO [RS:2;jenkins-hbase4:43375] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 20:00:41,724 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,724 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 20:00:41,724 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,724 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 20:00:41,725 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 20:00:41,734 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,734 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,734 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,734 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,734 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,734 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,734 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 20:00:41,735 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:2;jenkins-hbase4:43375] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,735 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,736 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,736 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,736 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,736 DEBUG [RS:0;jenkins-hbase4:37535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,736 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 20:00:41,736 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,737 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,737 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,737 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 20:00:41,737 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,738 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,758 INFO [RS:0;jenkins-hbase4:37535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 20:00:41,758 INFO [RS:2;jenkins-hbase4:43375] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 20:00:41,758 INFO [RS:1;jenkins-hbase4:46007] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 20:00:41,762 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37535,1695585640136-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,763 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43375,1695585640237-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,763 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46007,1695585640196-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:41,783 INFO [RS:0;jenkins-hbase4:37535] regionserver.Replication(203): jenkins-hbase4.apache.org,37535,1695585640136 started 2023-09-24 20:00:41,783 INFO [RS:1;jenkins-hbase4:46007] regionserver.Replication(203): jenkins-hbase4.apache.org,46007,1695585640196 started 2023-09-24 20:00:41,783 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37535,1695585640136, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37535, sessionid=0x100df86cd910001 2023-09-24 20:00:41,783 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46007,1695585640196, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46007, sessionid=0x100df86cd910002 2023-09-24 20:00:41,784 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 20:00:41,784 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 20:00:41,784 DEBUG [RS:1;jenkins-hbase4:46007] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,784 DEBUG [RS:0;jenkins-hbase4:37535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,784 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46007,1695585640196' 2023-09-24 20:00:41,784 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37535,1695585640136' 2023-09-24 20:00:41,785 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 20:00:41,785 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 20:00:41,786 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 20:00:41,786 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 20:00:41,786 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 20:00:41,786 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 20:00:41,786 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 20:00:41,787 DEBUG [RS:0;jenkins-hbase4:37535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:41,787 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 20:00:41,787 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37535,1695585640136' 2023-09-24 20:00:41,787 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:41,787 DEBUG [RS:0;jenkins-hbase4:37535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:41,788 DEBUG [RS:0;jenkins-hbase4:37535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 20:00:41,788 INFO [RS:0;jenkins-hbase4:37535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 20:00:41,788 INFO [RS:0;jenkins-hbase4:37535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 20:00:41,787 DEBUG [RS:1;jenkins-hbase4:46007] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:41,789 INFO [RS:2;jenkins-hbase4:43375] regionserver.Replication(203): jenkins-hbase4.apache.org,43375,1695585640237 started 2023-09-24 20:00:41,789 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46007,1695585640196' 2023-09-24 20:00:41,789 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:41,789 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43375,1695585640237, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43375, sessionid=0x100df86cd910003 2023-09-24 20:00:41,790 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 20:00:41,790 DEBUG [RS:2;jenkins-hbase4:43375] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,790 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43375,1695585640237' 2023-09-24 20:00:41,790 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 20:00:41,790 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:41,790 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 20:00:41,790 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 20:00:41,790 INFO [RS:1;jenkins-hbase4:46007] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 20:00:41,792 INFO [RS:1;jenkins-hbase4:46007] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43375,1695585640237' 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:41,792 DEBUG [RS:2;jenkins-hbase4:43375] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:41,793 DEBUG [RS:2;jenkins-hbase4:43375] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 20:00:41,793 INFO [RS:2;jenkins-hbase4:43375] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 20:00:41,793 INFO [RS:2;jenkins-hbase4:43375] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 20:00:41,813 DEBUG [jenkins-hbase4:40043] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-24 20:00:41,817 DEBUG [jenkins-hbase4:40043] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:00:41,823 DEBUG [jenkins-hbase4:40043] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:00:41,823 DEBUG [jenkins-hbase4:40043] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:00:41,823 DEBUG [jenkins-hbase4:40043] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:00:41,823 DEBUG [jenkins-hbase4:40043] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:00:41,826 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46007,1695585640196, state=OPENING 2023-09-24 20:00:41,835 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-24 20:00:41,836 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:41,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 20:00:41,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:00:41,900 INFO [RS:0;jenkins-hbase4:37535] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37535%2C1695585640136, suffix=, logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,37535,1695585640136, archiveDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs, maxLogs=32 2023-09-24 20:00:41,900 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46007%2C1695585640196, suffix=, logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,46007,1695585640196, archiveDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs, maxLogs=32 2023-09-24 20:00:41,900 INFO [RS:2;jenkins-hbase4:43375] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43375%2C1695585640237, suffix=, logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,43375,1695585640237, archiveDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs, maxLogs=32 2023-09-24 20:00:41,925 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK] 2023-09-24 20:00:41,925 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK] 2023-09-24 20:00:41,925 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK] 2023-09-24 20:00:41,941 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK] 2023-09-24 20:00:41,941 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK] 2023-09-24 20:00:41,942 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK] 2023-09-24 20:00:41,942 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK] 2023-09-24 20:00:41,942 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK] 2023-09-24 20:00:41,943 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK] 2023-09-24 20:00:41,944 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,46007,1695585640196/jenkins-hbase4.apache.org%2C46007%2C1695585640196.1695585641904 2023-09-24 20:00:41,957 DEBUG [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK], DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK], DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK]] 2023-09-24 20:00:41,961 INFO [RS:2;jenkins-hbase4:43375] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,43375,1695585640237/jenkins-hbase4.apache.org%2C43375%2C1695585640237.1695585641904 2023-09-24 20:00:41,961 INFO [RS:0;jenkins-hbase4:37535] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,37535,1695585640136/jenkins-hbase4.apache.org%2C37535%2C1695585640136.1695585641904 2023-09-24 20:00:41,964 DEBUG [RS:2;jenkins-hbase4:43375] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK], DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK], DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK]] 2023-09-24 20:00:41,964 DEBUG [RS:0;jenkins-hbase4:37535] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK], DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK], DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK]] 2023-09-24 20:00:42,035 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:42,039 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:00:42,043 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:00:42,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-24 20:00:42,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 20:00:42,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46007%2C1695585640196.meta, suffix=.meta, logDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,46007,1695585640196, archiveDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs, maxLogs=32 2023-09-24 20:00:42,090 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK] 2023-09-24 20:00:42,094 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK] 2023-09-24 20:00:42,094 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK] 2023-09-24 20:00:42,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/WALs/jenkins-hbase4.apache.org,46007,1695585640196/jenkins-hbase4.apache.org%2C46007%2C1695585640196.meta.1695585642064.meta 2023-09-24 20:00:42,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-720b468e-a65c-43a0-84a0-29d47a33d815,DISK], DatanodeInfoWithStorage[127.0.0.1:43251,DS-36a5f421-a5f2-47d8-828d-52e4d68be574,DISK], DatanodeInfoWithStorage[127.0.0.1:36525,DS-a6097408-3d1c-41e7-aeb5-d114ddd4762b,DISK]] 2023-09-24 20:00:42,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-24 20:00:42,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-24 20:00:42,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:42,111 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-24 20:00:42,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-24 20:00:42,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-24 20:00:42,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-24 20:00:42,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:42,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-24 20:00:42,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-24 20:00:42,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 20:00:42,133 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/info 2023-09-24 20:00:42,133 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/info 2023-09-24 20:00:42,134 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 20:00:42,135 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:42,135 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 20:00:42,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/rep_barrier 2023-09-24 20:00:42,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/rep_barrier 2023-09-24 20:00:42,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 20:00:42,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:42,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 20:00:42,140 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/table 2023-09-24 20:00:42,140 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/table 2023-09-24 20:00:42,140 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 20:00:42,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:42,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740 2023-09-24 20:00:42,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740 2023-09-24 20:00:42,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 20:00:42,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 20:00:42,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66040330, jitterRate=-0.01592239737510681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 20:00:42,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 20:00:42,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695585642023 2023-09-24 20:00:42,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-24 20:00:42,188 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-24 20:00:42,189 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46007,1695585640196, state=OPEN 2023-09-24 20:00:42,192 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-24 20:00:42,192 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 20:00:42,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-24 20:00:42,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46007,1695585640196 in 352 msec 2023-09-24 20:00:42,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-24 20:00:42,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 569 msec 2023-09-24 20:00:42,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 817 msec 2023-09-24 20:00:42,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695585642215, completionTime=-1 2023-09-24 20:00:42,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-24 20:00:42,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-24 20:00:42,292 DEBUG [hconnection-0x289a8375-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:42,295 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:42,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-24 20:00:42,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695585702322 2023-09-24 20:00:42,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695585762322 2023-09-24 20:00:42,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 105 msec 2023-09-24 20:00:42,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40043,1695585638864-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:42,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40043,1695585638864-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:42,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40043,1695585638864-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:42,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40043, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:42,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-24 20:00:42,358 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-24 20:00:42,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-24 20:00:42,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 20:00:42,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-24 20:00:42,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:00:42,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:00:42,408 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,412 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf empty. 2023-09-24 20:00:42,413 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,413 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-24 20:00:42,454 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-24 20:00:42,456 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31a7979cf71aa81458ff552f2329f0bf, NAME => 'hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 31a7979cf71aa81458ff552f2329f0bf, disabling compactions & flushes 2023-09-24 20:00:42,477 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. after waiting 0 ms 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,477 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,477 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 31a7979cf71aa81458ff552f2329f0bf: 2023-09-24 20:00:42,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:00:42,497 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695585642485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585642485"}]},"ts":"1695585642485"} 2023-09-24 20:00:42,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 20:00:42,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:00:42,538 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585642533"}]},"ts":"1695585642533"} 2023-09-24 20:00:42,545 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-24 20:00:42,550 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:00:42,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:00:42,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:00:42,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:00:42,551 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:00:42,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=31a7979cf71aa81458ff552f2329f0bf, ASSIGN}] 2023-09-24 20:00:42,559 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=31a7979cf71aa81458ff552f2329f0bf, ASSIGN 2023-09-24 20:00:42,561 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=31a7979cf71aa81458ff552f2329f0bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:00:42,714 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 20:00:42,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=31a7979cf71aa81458ff552f2329f0bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:42,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695585642715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585642715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585642715"}]},"ts":"1695585642715"} 2023-09-24 20:00:42,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 31a7979cf71aa81458ff552f2329f0bf, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:00:42,877 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:42,877 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:00:42,880 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:00:42,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31a7979cf71aa81458ff552f2329f0bf, NAME => 'hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.', STARTKEY => '', ENDKEY => ''} 2023-09-24 20:00:42,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. service=AccessControlService 2023-09-24 20:00:42,889 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:42,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:42,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,892 INFO [StoreOpener-31a7979cf71aa81458ff552f2329f0bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,895 DEBUG [StoreOpener-31a7979cf71aa81458ff552f2329f0bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/info 2023-09-24 20:00:42,895 DEBUG [StoreOpener-31a7979cf71aa81458ff552f2329f0bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/info 2023-09-24 20:00:42,895 INFO [StoreOpener-31a7979cf71aa81458ff552f2329f0bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31a7979cf71aa81458ff552f2329f0bf columnFamilyName info 2023-09-24 20:00:42,896 INFO [StoreOpener-31a7979cf71aa81458ff552f2329f0bf-1] regionserver.HStore(310): Store=31a7979cf71aa81458ff552f2329f0bf/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:42,898 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,899 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:00:42,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:42,911 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 31a7979cf71aa81458ff552f2329f0bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67810363, jitterRate=0.010453149676322937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:00:42,911 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 31a7979cf71aa81458ff552f2329f0bf: 2023-09-24 20:00:42,913 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf., pid=6, masterSystemTime=1695585642877 2023-09-24 20:00:42,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:00:42,921 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=31a7979cf71aa81458ff552f2329f0bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:42,922 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695585642921"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585642921"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585642921"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585642921"}]},"ts":"1695585642921"} 2023-09-24 20:00:42,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-24 20:00:42,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 31a7979cf71aa81458ff552f2329f0bf, server=jenkins-hbase4.apache.org,43375,1695585640237 in 204 msec 2023-09-24 20:00:42,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-24 20:00:42,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=31a7979cf71aa81458ff552f2329f0bf, ASSIGN in 376 msec 2023-09-24 20:00:42,936 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:00:42,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585642936"}]},"ts":"1695585642936"} 2023-09-24 20:00:42,939 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-24 20:00:42,942 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:00:42,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 573 msec 2023-09-24 20:00:42,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-24 20:00:42,982 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-24 20:00:42,983 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:43,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:43,007 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:43,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-24 20:00:43,040 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 20:00:43,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-09-24 20:00:43,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-24 20:00:43,065 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 20:00:43,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-24 20:00:43,085 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-24 20:00:43,088 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-24 20:00:43,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.785sec 2023-09-24 20:00:43,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-24 20:00:43,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-24 20:00:43,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-24 20:00:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40043,1695585638864-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-24 20:00:43,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40043,1695585638864-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-24 20:00:43,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 20:00:43,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-24 20:00:43,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:00:43,124 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:00:43,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-24 20:00:43,127 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/acl/a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,128 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/acl/a2c5586146040b58bb9b129322a42cda empty. 2023-09-24 20:00:43,132 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/acl/a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,132 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-24 20:00:43,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 20:00:43,158 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-24 20:00:43,160 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2c5586146040b58bb9b129322a42cda, NAME => 'hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:00:43,170 DEBUG [Listener at localhost/45415] zookeeper.ReadOnlyZKClient(139): Connect 0x3a20d86f to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:43,180 DEBUG [Listener at localhost/45415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3204b0f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:43,187 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:43,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a2c5586146040b58bb9b129322a42cda, disabling compactions & flushes 2023-09-24 20:00:43,188 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. after waiting 0 ms 2023-09-24 20:00:43,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,188 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,188 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a2c5586146040b58bb9b129322a42cda: 2023-09-24 20:00:43,194 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:00:43,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695585643195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585643195"}]},"ts":"1695585643195"} 2023-09-24 20:00:43,200 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 20:00:43,200 DEBUG [hconnection-0x5a782b32-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:43,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:00:43,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585643201"}]},"ts":"1695585643201"} 2023-09-24 20:00:43,205 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-24 20:00:43,210 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:00:43,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:00:43,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:00:43,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:00:43,211 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:00:43,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a2c5586146040b58bb9b129322a42cda, ASSIGN}] 2023-09-24 20:00:43,213 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:43,214 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a2c5586146040b58bb9b129322a42cda, ASSIGN 2023-09-24 20:00:43,216 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a2c5586146040b58bb9b129322a42cda, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:00:43,217 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:00:43,217 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-24 20:00:43,217 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/test.cache.data in system properties and HBase conf 2023-09-24 20:00:43,217 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop.log.dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 20:00:43,218 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 20:00:43,219 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/nfs.dump.dir in system properties and HBase conf 2023-09-24 20:00:43,219 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir in system properties and HBase conf 2023-09-24 20:00:43,219 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 20:00:43,219 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 20:00:43,219 INFO [Listener at localhost/45415] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-24 20:00:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 20:00:43,366 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 20:00:43,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a2c5586146040b58bb9b129322a42cda, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:43,367 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695585643367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585643367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585643367"}]},"ts":"1695585643367"} 2023-09-24 20:00:43,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a2c5586146040b58bb9b129322a42cda, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:00:43,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 20:00:43,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2c5586146040b58bb9b129322a42cda, NAME => 'hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.', STARTKEY => '', ENDKEY => ''} 2023-09-24 20:00:43,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. service=AccessControlService 2023-09-24 20:00:43,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:43,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:43,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,537 INFO [StoreOpener-a2c5586146040b58bb9b129322a42cda-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,540 DEBUG [StoreOpener-a2c5586146040b58bb9b129322a42cda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/l 2023-09-24 20:00:43,540 DEBUG [StoreOpener-a2c5586146040b58bb9b129322a42cda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/l 2023-09-24 20:00:43,540 INFO [StoreOpener-a2c5586146040b58bb9b129322a42cda-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2c5586146040b58bb9b129322a42cda columnFamilyName l 2023-09-24 20:00:43,542 INFO [StoreOpener-a2c5586146040b58bb9b129322a42cda-1] regionserver.HStore(310): Store=a2c5586146040b58bb9b129322a42cda/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:43,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2c5586146040b58bb9b129322a42cda 2023-09-24 20:00:43,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:43,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2c5586146040b58bb9b129322a42cda; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62943154, jitterRate=-0.06207391619682312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:00:43,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2c5586146040b58bb9b129322a42cda: 2023-09-24 20:00:43,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda., pid=11, masterSystemTime=1695585643524 2023-09-24 20:00:43,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,565 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:00:43,567 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a2c5586146040b58bb9b129322a42cda, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:43,567 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695585643567"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585643567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585643567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585643567"}]},"ts":"1695585643567"} 2023-09-24 20:00:43,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-24 20:00:43,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a2c5586146040b58bb9b129322a42cda, server=jenkins-hbase4.apache.org,46007,1695585640196 in 200 msec 2023-09-24 20:00:43,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-24 20:00:43,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a2c5586146040b58bb9b129322a42cda, ASSIGN in 367 msec 2023-09-24 20:00:43,585 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:00:43,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585643585"}]},"ts":"1695585643585"} 2023-09-24 20:00:43,588 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-24 20:00:43,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:00:43,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 474 msec 2023-09-24 20:00:43,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 20:00:43,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-24 20:00:43,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-24 20:00:44,510 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:44,885 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:44,892 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33993_jobhistory____51v998/webapp 2023-09-24 20:00:45,067 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-24 20:00:45,067 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-24 20:00:45,068 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 20:00:45,071 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 20:00:45,156 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:45,487 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:45,754 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-24 20:00:45,783 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33993 2023-09-24 20:00:46,002 WARN [Listener at jenkins-hbase4.apache.org/32983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:46,259 WARN [Listener at jenkins-hbase4.apache.org/32983] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 20:00:46,260 INFO [Listener at jenkins-hbase4.apache.org/32983] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:46,267 INFO [Listener at jenkins-hbase4.apache.org/32983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46877_cluster____uiwuq6/webapp 2023-09-24 20:00:46,342 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 20:00:46,342 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-24 20:00:46,342 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 20:00:46,343 INFO [Listener at jenkins-hbase4.apache.org/32983] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 20:00:46,354 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:46,603 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:46,703 INFO [Listener at jenkins-hbase4.apache.org/32983] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:46,712 INFO [Listener at jenkins-hbase4.apache.org/32983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46877 2023-09-24 20:00:47,211 WARN [Listener at jenkins-hbase4.apache.org/46731] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:47,235 WARN [Listener at jenkins-hbase4.apache.org/46731] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 20:00:47,236 INFO [Listener at jenkins-hbase4.apache.org/46731] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:47,243 INFO [Listener at jenkins-hbase4.apache.org/46731] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39969_node____c4w5hw/webapp 2023-09-24 20:00:47,295 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 20:00:47,295 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 20:00:47,295 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 20:00:47,295 INFO [Listener at jenkins-hbase4.apache.org/46731] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 20:00:47,304 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,326 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,422 INFO [Listener at jenkins-hbase4.apache.org/46731] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,436 INFO [Listener at jenkins-hbase4.apache.org/46731] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39969 2023-09-24 20:00:47,596 WARN [Listener at jenkins-hbase4.apache.org/39171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 20:00:47,605 WARN [Listener at jenkins-hbase4.apache.org/39171] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 20:00:47,606 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 20:00:47,616 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37683_node____.e90jcl/webapp 2023-09-24 20:00:47,676 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 20:00:47,676 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 20:00:47,677 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 20:00:47,677 INFO [Listener at jenkins-hbase4.apache.org/39171] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 20:00:47,680 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:00:47,686 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,731 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,860 INFO [Listener at jenkins-hbase4.apache.org/39171] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 20:00:47,866 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-24 20:00:47,868 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-24 20:00:47,869 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37683 2023-09-24 20:00:47,871 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-24 20:00:47,903 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-24 20:00:47,905 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:00:47,972 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=165, AvailableMemoryMB=8629 2023-09-24 20:00:47,972 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-24 20:00:47,986 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-24 20:00:47,992 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-24 20:00:47,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:00:48,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:00:48,005 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:00:48,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-24 20:00:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 20:00:48,009 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:00:48,013 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,013 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,014 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff empty. 2023-09-24 20:00:48,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 empty. 2023-09-24 20:00:48,017 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,017 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 20:00:48,052 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-24 20:00:48,053 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d044ab34889ff5374bdc9eef530e463, NAME => 'testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:00:48,054 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 17330282a5079b3999dc25b01fe080ff, NAME => 'testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:00:48,090 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:48,090 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 17330282a5079b3999dc25b01fe080ff, disabling compactions & flushes 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4d044ab34889ff5374bdc9eef530e463, disabling compactions & flushes 2023-09-24 20:00:48,091 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,091 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. after waiting 0 ms 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. after waiting 0 ms 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,091 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,092 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,092 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,092 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 17330282a5079b3999dc25b01fe080ff: 2023-09-24 20:00:48,092 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4d044ab34889ff5374bdc9eef530e463: 2023-09-24 20:00:48,095 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:00:48,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585648096"}]},"ts":"1695585648096"} 2023-09-24 20:00:48,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585648096"}]},"ts":"1695585648096"} 2023-09-24 20:00:48,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 20:00:48,146 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:00:48,148 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:00:48,148 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585648148"}]},"ts":"1695585648148"} 2023-09-24 20:00:48,150 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-24 20:00:48,156 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:00:48,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:00:48,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:00:48,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:00:48,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:00:48,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, ASSIGN}] 2023-09-24 20:00:48,166 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, ASSIGN 2023-09-24 20:00:48,167 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, ASSIGN 2023-09-24 20:00:48,168 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:00:48,168 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37535,1695585640136; forceNewPlan=false, retain=false 2023-09-24 20:00:48,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 20:00:48,319 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:00:48,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d044ab34889ff5374bdc9eef530e463, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:48,321 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=17330282a5079b3999dc25b01fe080ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:48,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585648321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585648321"}]},"ts":"1695585648321"} 2023-09-24 20:00:48,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585648321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585648321"}]},"ts":"1695585648321"} 2023-09-24 20:00:48,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4d044ab34889ff5374bdc9eef530e463, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:00:48,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 17330282a5079b3999dc25b01fe080ff, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:00:48,478 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:48,478 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:00:48,482 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:00:48,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17330282a5079b3999dc25b01fe080ff, NAME => 'testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:00:48,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. service=AccessControlService 2023-09-24 20:00:48,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:48,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d044ab34889ff5374bdc9eef530e463, NAME => 'testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. service=AccessControlService 2023-09-24 20:00:48,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:00:48,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,495 INFO [StoreOpener-17330282a5079b3999dc25b01fe080ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,495 INFO [StoreOpener-4d044ab34889ff5374bdc9eef530e463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,497 DEBUG [StoreOpener-17330282a5079b3999dc25b01fe080ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf 2023-09-24 20:00:48,497 DEBUG [StoreOpener-17330282a5079b3999dc25b01fe080ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf 2023-09-24 20:00:48,497 DEBUG [StoreOpener-4d044ab34889ff5374bdc9eef530e463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf 2023-09-24 20:00:48,498 DEBUG [StoreOpener-4d044ab34889ff5374bdc9eef530e463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf 2023-09-24 20:00:48,501 INFO [StoreOpener-4d044ab34889ff5374bdc9eef530e463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d044ab34889ff5374bdc9eef530e463 columnFamilyName cf 2023-09-24 20:00:48,501 INFO [StoreOpener-17330282a5079b3999dc25b01fe080ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17330282a5079b3999dc25b01fe080ff columnFamilyName cf 2023-09-24 20:00:48,504 INFO [StoreOpener-4d044ab34889ff5374bdc9eef530e463-1] regionserver.HStore(310): Store=4d044ab34889ff5374bdc9eef530e463/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:48,504 INFO [StoreOpener-17330282a5079b3999dc25b01fe080ff-1] regionserver.HStore(310): Store=17330282a5079b3999dc25b01fe080ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:00:48,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:00:48,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:00:48,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:48,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:00:48,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17330282a5079b3999dc25b01fe080ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69673111, jitterRate=0.03821025788784027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:00:48,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d044ab34889ff5374bdc9eef530e463; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71915900, jitterRate=0.07163041830062866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:00:48,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17330282a5079b3999dc25b01fe080ff: 2023-09-24 20:00:48,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d044ab34889ff5374bdc9eef530e463: 2023-09-24 20:00:48,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff., pid=16, masterSystemTime=1695585648478 2023-09-24 20:00:48,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463., pid=15, masterSystemTime=1695585648478 2023-09-24 20:00:48,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:48,534 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=17330282a5079b3999dc25b01fe080ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:48,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,534 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648534"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585648534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585648534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585648534"}]},"ts":"1695585648534"} 2023-09-24 20:00:48,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:48,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d044ab34889ff5374bdc9eef530e463, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:48,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585648536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585648536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585648536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585648536"}]},"ts":"1695585648536"} 2023-09-24 20:00:48,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-24 20:00:48,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 17330282a5079b3999dc25b01fe080ff, server=jenkins-hbase4.apache.org,46007,1695585640196 in 214 msec 2023-09-24 20:00:48,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-24 20:00:48,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4d044ab34889ff5374bdc9eef530e463, server=jenkins-hbase4.apache.org,37535,1695585640136 in 217 msec 2023-09-24 20:00:48,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, ASSIGN in 381 msec 2023-09-24 20:00:48,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-24 20:00:48,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, ASSIGN in 383 msec 2023-09-24 20:00:48,550 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:00:48,550 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585648550"}]},"ts":"1695585648550"} 2023-09-24 20:00:48,552 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-24 20:00:48,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:00:48,561 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-24 20:00:48,576 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 20:00:48,604 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 20:00:48,604 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 20:00:48,604 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:00:48,604 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 20:00:48,604 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 20:00:48,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 20:00:48,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 20:00:48,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 20:00:48,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 20:00:48,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 20:00:48,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 614 msec 2023-09-24 20:00:49,032 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:00:49,033 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-24 20:00:49,034 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:00:49,034 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-24 20:00:49,034 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 20:00:49,034 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-24 20:00:49,034 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:00:49,034 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-24 20:00:49,034 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 20:00:49,034 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-24 20:00:49,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 20:00:49,117 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-24 20:00:49,121 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 20:00:49,122 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,124 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:00:49,149 DEBUG [hconnection-0x5a782b32-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:49,155 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:49,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585649175 (current time:1695585649175). 2023-09-24 20:00:49,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:00:49,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x2df6afb0 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:49,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297cb9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:49,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:49,188 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:49,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2df6afb0 to 127.0.0.1:61864 2023-09-24 20:00:49,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:00:49,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x7a162fc8 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:49,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@98f186, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:49,212 DEBUG [hconnection-0x7b08f85d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:49,216 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:49,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a162fc8 to 127.0.0.1:61864 2023-09-24 20:00:49,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:00:49,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 20:00:49,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:00:49,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,275 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,276 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695586249276 2023-09-24 20:00:49,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 20:00:49,279 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:49,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-24 20:00:49,282 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:49,283 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695586249283 2023-09-24 20:00:49,285 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:00:49,285 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:00:49,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,314 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-24 20:00:49,314 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,315 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 20:00:49,315 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 20:00:49,316 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,316 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,323 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,323 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,324 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,324 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,324 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,336 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,339 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,339 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,339 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,339 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,340 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1426300e[Count = 1] remaining members to acquire global barrier 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 20:00:49,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1426300e[Count = 0] remaining members to acquire global barrier 2023-09-24 20:00:49,346 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 20:00:49,346 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,348 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,348 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,348 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,349 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,349 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,349 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,349 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:00:49,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:00:49,354 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,354 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,354 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:00:49,355 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. started... 2023-09-24 20:00:49,355 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. started... 2023-09-24 20:00:49,354 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,356 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,356 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:00:49,359 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d044ab34889ff5374bdc9eef530e463: 2023-09-24 20:00:49,359 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17330282a5079b3999dc25b01fe080ff: 2023-09-24 20:00:49,360 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,360 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,365 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:00:49,365 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:00:49,369 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:00:49,369 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:00:49,385 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:00:49,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 20:00:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:00:49,397 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:00:49,400 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. completed. 2023-09-24 20:00:49,401 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:49,401 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:00:49,401 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:00:49,401 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,401 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,401 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:00:49,403 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,403 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,404 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,404 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,406 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. completed. 2023-09-24 20:00:49,406 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,406 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:00:49,406 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:00:49,406 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,406 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,407 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:00:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,408 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,408 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,408 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,408 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:00:49,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 20:00:49,417 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-24 20:00:49,417 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:00:49,417 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:00:49,417 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,417 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:00:49,420 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,420 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,420 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,420 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,421 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,422 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,422 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,423 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,425 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,426 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,426 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,441 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 20:00:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,441 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,443 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,443 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,443 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:00:49,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,444 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,444 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,444 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,444 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,444 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:00:49,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 20:00:49,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,522 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 20:00:49,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695585649277Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695585649464 (+187 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695585649464Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695585649465 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695585649477 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695585649509 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695585649522 (+13 ms) 2023-09-24 20:00:49,525 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:49,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 246 msec 2023-09-24 20:00:49,597 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:00:49,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 20:00:49,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:00:49,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:00:49,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:00:49,625 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 20:00:49,625 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,625 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:00:49,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585649641 (current time:1695585649641). 2023-09-24 20:00:49,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:00:49,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x2dad9f65 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:49,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d1cbef3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:49,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:49,651 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:49,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dad9f65 to 127.0.0.1:61864 2023-09-24 20:00:49,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:00:49,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x18a8c173 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:00:49,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19d39a02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:00:49,661 DEBUG [hconnection-0xf131a3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:00:49,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:00:49,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18a8c173 to 127.0.0.1:61864 2023-09-24 20:00:49,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:00:49,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 20:00:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:00:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,676 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,678 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695586249678 2023-09-24 20:00:49,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 20:00:49,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 20:00:49,679 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:00:49,679 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:00:49,681 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 20:00:49,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:49,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-24 20:00:49,683 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:49,684 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695586249684 2023-09-24 20:00:49,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-24 20:00:49,704 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-24 20:00:49,704 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 20:00:49,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 20:00:49,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,707 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,707 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:49,707 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,708 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 20:00:49,710 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,710 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 20:00:49,710 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,710 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,711 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 20:00:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 20:00:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:00:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,713 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 20:00:49,713 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 20:00:49,713 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 20:00:49,715 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,717 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,717 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:00:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47cd17c2[Count = 1] remaining members to acquire global barrier 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 20:00:49,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47cd17c2[Count = 0] remaining members to acquire global barrier 2023-09-24 20:00:49,723 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 20:00:49,723 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,728 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,728 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,728 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,729 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:00:49,729 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:49,729 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,729 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,729 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,729 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. started... 2023-09-24 20:00:49,729 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. started... 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:00:49,729 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:00:49,730 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d044ab34889ff5374bdc9eef530e463 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-24 20:00:49,730 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17330282a5079b3999dc25b01fe080ff 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-24 20:00:49,732 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,733 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,733 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,780 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:00:49,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 20:00:49,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:00:49,781 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:00:49,870 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491 2023-09-24 20:00:49,870 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b 2023-09-24 20:00:49,904 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/.tmp/cf/d3675968d037494e99c2ec4380fb4670 2023-09-24 20:00:49,904 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/.tmp/cf/eb0b253196284559ac61ae0c9f4068cd 2023-09-24 20:00:49,919 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/.tmp/cf/eb0b253196284559ac61ae0c9f4068cd as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd 2023-09-24 20:00:49,919 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/.tmp/cf/d3675968d037494e99c2ec4380fb4670 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670 2023-09-24 20:00:49,929 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd, entries=2, sequenceid=6, filesize=5.2 K 2023-09-24 20:00:49,931 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670, entries=48, sequenceid=6, filesize=13.0 K 2023-09-24 20:00:49,935 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4d044ab34889ff5374bdc9eef530e463 in 205ms, sequenceid=6, compaction requested=false 2023-09-24 20:00:49,935 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 17330282a5079b3999dc25b01fe080ff in 205ms, sequenceid=6, compaction requested=false 2023-09-24 20:00:49,935 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 20:00:49,935 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17330282a5079b3999dc25b01fe080ff: 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d044ab34889ff5374bdc9eef530e463: 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670] hfiles 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670 for snapshot=snaptb0-testExportWithTargetName 2023-09-24 20:00:49,938 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd] hfiles 2023-09-24 20:00:49,939 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd for snapshot=snaptb0-testExportWithTargetName 2023-09-24 20:00:49,967 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. completed. 2023-09-24 20:00:49,968 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:00:49,968 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. completed. 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:00:49,968 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:00:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:00:49,970 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,970 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,970 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,970 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,971 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 20:00:49,971 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,972 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:49,972 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 20:00:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,982 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:00:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 20:00:49,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:00:49,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,983 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-24 20:00:49,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:00:49,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 20:00:49,986 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-24 20:00:49,986 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:00:49,986 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:00:49,986 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-24 20:00:49,986 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:00:49,994 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,994 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:00:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:00:49,994 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,994 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,994 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,995 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:00:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,995 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,996 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:00:49,996 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:49,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:50,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:50,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:00:50,001 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 20:00:50,002 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:50,002 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:50,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:50,014 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:50,014 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,014 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:50,014 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:50,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:50,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:50,014 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:00:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:50,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:00:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:00:50,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:50,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:50,016 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:00:50,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-24 20:00:50,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:00:50,015 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:00:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:50,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 20:00:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:00:50,017 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 20:00:50,017 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:00:50,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491] mob files 2023-09-24 20:00:50,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b 2023-09-24 20:00:50,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491 2023-09-24 20:00:50,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-24 20:00:50,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 20:00:50,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,080 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 20:00:50,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695585649678Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695585650035 (+357 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695585650035Loading Region manifests for snaptb0-testExportWithTargetName at 1695585650036 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1695585650046 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695585650067 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695585650079 (+12 ms) 2023-09-24 20:00:50,082 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 20:00:50,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 404 msec 2023-09-24 20:00:50,283 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:00:50,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 20:00:50,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:00:50,287 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287 2023-09-24 20:00:50,287 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32847, tgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287, rawTgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:50,327 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:00:50,327 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1529152125_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 20:00:50,327 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-24 20:00:50,347 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 20:00:50,413 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:50,414 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:50,414 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:50,415 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,333 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-3945113092106335342.jar 2023-09-24 20:00:51,334 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,334 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,403 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-1948408946612949742.jar 2023-09-24 20:00:51,404 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,405 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,405 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,406 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,406 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,406 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:00:51,407 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:00:51,407 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:00:51,408 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:00:51,408 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:00:51,409 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:00:51,410 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:00:51,410 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:00:51,411 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:00:51,411 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:00:51,412 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:00:51,418 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:00:51,418 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:00:51,419 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:00:51,419 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:00:51,420 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:00:51,421 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:00:51,421 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:00:52,270 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:00:52,276 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-24 20:00:52,284 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 20:00:52,722 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:00:52,724 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:00:53,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0001_000001 (auth:SIMPLE) 2023-09-24 20:00:53,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:00:57,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0001_000001 (auth:SIMPLE) 2023-09-24 20:00:59,748 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0001_000001 (auth:SIMPLE) 2023-09-24 20:01:03,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0001_000001 (auth:SIMPLE) 2023-09-24 20:01:05,119 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:01:05,123 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:01:05,132 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-24 20:01:05,132 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:01:05,133 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:01:05,133 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 20:01:05,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-24 20:01:05,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-24 20:01:05,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/testExportWithTargetName 2023-09-24 20:01:05,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-24 20:01:05,135 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585650287/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-24 20:01:05,145 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-24 20:01:05,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-24 20:01:05,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,162 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585665162"}]},"ts":"1695585665162"} 2023-09-24 20:01:05,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 20:01:05,164 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-24 20:01:05,166 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-24 20:01:05,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, UNASSIGN}] 2023-09-24 20:01:05,170 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, UNASSIGN 2023-09-24 20:01:05,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, UNASSIGN 2023-09-24 20:01:05,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d044ab34889ff5374bdc9eef530e463, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:05,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=17330282a5079b3999dc25b01fe080ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:05,172 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585665171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585665171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585665171"}]},"ts":"1695585665171"} 2023-09-24 20:01:05,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585665171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585665171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585665171"}]},"ts":"1695585665171"} 2023-09-24 20:01:05,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 4d044ab34889ff5374bdc9eef530e463, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:05,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 17330282a5079b3999dc25b01fe080ff, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:01:05,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 20:01:05,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:01:05,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17330282a5079b3999dc25b01fe080ff, disabling compactions & flushes 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d044ab34889ff5374bdc9eef530e463, disabling compactions & flushes 2023-09-24 20:01:05,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:01:05,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. after waiting 0 ms 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. after waiting 0 ms 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:01:05,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:01:05,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:05,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:05,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:05,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:05,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463. 2023-09-24 20:01:05,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff. 2023-09-24 20:01:05,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d044ab34889ff5374bdc9eef530e463: 2023-09-24 20:01:05,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17330282a5079b3999dc25b01fe080ff: 2023-09-24 20:01:05,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:01:05,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4d044ab34889ff5374bdc9eef530e463, regionState=CLOSED 2023-09-24 20:01:05,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17330282a5079b3999dc25b01fe080ff 2023-09-24 20:01:05,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585665360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585665360"}]},"ts":"1695585665360"} 2023-09-24 20:01:05,361 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=17330282a5079b3999dc25b01fe080ff, regionState=CLOSED 2023-09-24 20:01:05,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695585665361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585665361"}]},"ts":"1695585665361"} 2023-09-24 20:01:05,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-24 20:01:05,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 4d044ab34889ff5374bdc9eef530e463, server=jenkins-hbase4.apache.org,37535,1695585640136 in 189 msec 2023-09-24 20:01:05,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-24 20:01:05,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 17330282a5079b3999dc25b01fe080ff, server=jenkins-hbase4.apache.org,46007,1695585640196 in 189 msec 2023-09-24 20:01:05,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4d044ab34889ff5374bdc9eef530e463, UNASSIGN in 198 msec 2023-09-24 20:01:05,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-24 20:01:05,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=17330282a5079b3999dc25b01fe080ff, UNASSIGN in 199 msec 2023-09-24 20:01:05,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585665372"}]},"ts":"1695585665372"} 2023-09-24 20:01:05,373 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-24 20:01:05,375 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-24 20:01:05,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-09-24 20:01:05,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 20:01:05,467 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-24 20:01:05,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-24 20:01:05,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,481 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-24 20:01:05,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,487 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-24 20:01:05,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:01:05,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:01:05,491 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 20:01:05,491 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 20:01:05,491 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 20:01:05,491 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 20:01:05,493 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:05,493 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:05,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 20:01:05,493 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:05,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 20:01:05,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 20:01:05,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 20:01:05,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 20:01:05,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 20:01:05,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 20:01:05,493 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:05,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 20:01:05,495 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/recovered.edits] 2023-09-24 20:01:05,497 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/recovered.edits] 2023-09-24 20:01:05,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 20:01:05,504 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/cf/d3675968d037494e99c2ec4380fb4670 2023-09-24 20:01:05,504 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/cf/eb0b253196284559ac61ae0c9f4068cd 2023-09-24 20:01:05,508 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff/recovered.edits/9.seqid 2023-09-24 20:01:05,508 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463/recovered.edits/9.seqid 2023-09-24 20:01:05,509 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/17330282a5079b3999dc25b01fe080ff 2023-09-24 20:01:05,509 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportWithTargetName/4d044ab34889ff5374bdc9eef530e463 2023-09-24 20:01:05,509 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 20:01:05,510 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 20:01:05,510 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-24 20:01:05,514 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092453a2fe754caf473480ffa0e7c909d24b 2023-09-24 20:01:05,515 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924fcb94e358c154a0cad4e8b7e18d5c491 2023-09-24 20:01:05,516 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 20:01:05,519 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,540 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-24 20:01:05,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-24 20:01:05,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-24 20:01:05,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585665545"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:05,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585665545"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:05,547 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:01:05,547 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d044ab34889ff5374bdc9eef530e463, NAME => 'testtb-testExportWithTargetName,,1695585647999.4d044ab34889ff5374bdc9eef530e463.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17330282a5079b3999dc25b01fe080ff, NAME => 'testtb-testExportWithTargetName,1,1695585647999.17330282a5079b3999dc25b01fe080ff.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:01:05,548 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-24 20:01:05,548 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585665548"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:05,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-24 20:01:05,553 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 20:01:05,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-09-24 20:01:05,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 20:01:05,601 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-24 20:01:05,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-24 20:01:05,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-24 20:01:05,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-24 20:01:05,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-24 20:01:05,669 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 708) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x289a8375-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:43984 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:45113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1513301069_1 at /127.0.0.1:53980 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:39099 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:53994 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:49802 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:46731 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1513301069_1 at /127.0.0.1:43966 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 162) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=7809 (was 8629) 2023-09-24 20:01:05,670 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 20:01:05,691 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=168, AvailableMemoryMB=7809 2023-09-24 20:01:05,691 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 20:01:05,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:01:05,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:05,699 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:01:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-24 20:01:05,702 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:01:05,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 20:01:05,705 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:05,705 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:05,706 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 empty. 2023-09-24 20:01:05,706 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec empty. 2023-09-24 20:01:05,706 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:05,706 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:05,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 20:01:05,719 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 20:01:05,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e7e999c6c12fb69ae1b9cfe1e572cf4, NAME => 'testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:05,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f77f9191754148d3047b7f5c321d3ec, NAME => 'testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5f77f9191754148d3047b7f5c321d3ec, disabling compactions & flushes 2023-09-24 20:01:05,747 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. after waiting 0 ms 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:05,747 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:05,747 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5f77f9191754148d3047b7f5c321d3ec: 2023-09-24 20:01:05,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6e7e999c6c12fb69ae1b9cfe1e572cf4, disabling compactions & flushes 2023-09-24 20:01:05,748 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:05,748 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:05,749 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. after waiting 0 ms 2023-09-24 20:01:05,749 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:05,749 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:05,749 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6e7e999c6c12fb69ae1b9cfe1e572cf4: 2023-09-24 20:01:05,752 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:01:05,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585665753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585665753"}]},"ts":"1695585665753"} 2023-09-24 20:01:05,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585665753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585665753"}]},"ts":"1695585665753"} 2023-09-24 20:01:05,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:01:05,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:01:05,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585665756"}]},"ts":"1695585665756"} 2023-09-24 20:01:05,758 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 20:01:05,762 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:01:05,764 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:01:05,764 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:01:05,764 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:01:05,764 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:01:05,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, ASSIGN}] 2023-09-24 20:01:05,767 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, ASSIGN 2023-09-24 20:01:05,767 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, ASSIGN 2023-09-24 20:01:05,768 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37535,1695585640136; forceNewPlan=false, retain=false 2023-09-24 20:01:05,768 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:01:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 20:01:05,918 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:01:05,920 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f77f9191754148d3047b7f5c321d3ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:05,920 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6e7e999c6c12fb69ae1b9cfe1e572cf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:05,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585665920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585665920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585665920"}]},"ts":"1695585665920"} 2023-09-24 20:01:05,920 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585665920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585665920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585665920"}]},"ts":"1695585665920"} 2023-09-24 20:01:05,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 5f77f9191754148d3047b7f5c321d3ec, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:05,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6e7e999c6c12fb69ae1b9cfe1e572cf4, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:06,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 20:01:06,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:06,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f77f9191754148d3047b7f5c321d3ec, NAME => 'testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:01:06,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. service=AccessControlService 2023-09-24 20:01:06,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:06,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:06,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,086 INFO [StoreOpener-5f77f9191754148d3047b7f5c321d3ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e7e999c6c12fb69ae1b9cfe1e572cf4, NAME => 'testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:01:06,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. service=AccessControlService 2023-09-24 20:01:06,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:06,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:06,088 DEBUG [StoreOpener-5f77f9191754148d3047b7f5c321d3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf 2023-09-24 20:01:06,088 DEBUG [StoreOpener-5f77f9191754148d3047b7f5c321d3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf 2023-09-24 20:01:06,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,089 INFO [StoreOpener-5f77f9191754148d3047b7f5c321d3ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f77f9191754148d3047b7f5c321d3ec columnFamilyName cf 2023-09-24 20:01:06,090 INFO [StoreOpener-6e7e999c6c12fb69ae1b9cfe1e572cf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,090 INFO [StoreOpener-5f77f9191754148d3047b7f5c321d3ec-1] regionserver.HStore(310): Store=5f77f9191754148d3047b7f5c321d3ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:06,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,092 DEBUG [StoreOpener-6e7e999c6c12fb69ae1b9cfe1e572cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf 2023-09-24 20:01:06,093 DEBUG [StoreOpener-6e7e999c6c12fb69ae1b9cfe1e572cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf 2023-09-24 20:01:06,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,093 INFO [StoreOpener-6e7e999c6c12fb69ae1b9cfe1e572cf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e7e999c6c12fb69ae1b9cfe1e572cf4 columnFamilyName cf 2023-09-24 20:01:06,094 INFO [StoreOpener-6e7e999c6c12fb69ae1b9cfe1e572cf4-1] regionserver.HStore(310): Store=6e7e999c6c12fb69ae1b9cfe1e572cf4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:06,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:06,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:06,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f77f9191754148d3047b7f5c321d3ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69915969, jitterRate=0.041829124093055725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:06,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f77f9191754148d3047b7f5c321d3ec: 2023-09-24 20:01:06,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:06,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec., pid=30, masterSystemTime=1695585666075 2023-09-24 20:01:06,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:06,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:06,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:06,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e7e999c6c12fb69ae1b9cfe1e572cf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66869303, jitterRate=-0.0035697370767593384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:06,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e7e999c6c12fb69ae1b9cfe1e572cf4: 2023-09-24 20:01:06,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f77f9191754148d3047b7f5c321d3ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,105 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585666104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585666104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585666104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585666104"}]},"ts":"1695585666104"} 2023-09-24 20:01:06,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4., pid=31, masterSystemTime=1695585666077 2023-09-24 20:01:06,108 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-24 20:01:06,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,110 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6e7e999c6c12fb69ae1b9cfe1e572cf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,110 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585666110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585666110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585666110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585666110"}]},"ts":"1695585666110"} 2023-09-24 20:01:06,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-24 20:01:06,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 5f77f9191754148d3047b7f5c321d3ec, server=jenkins-hbase4.apache.org,37535,1695585640136 in 184 msec 2023-09-24 20:01:06,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, ASSIGN in 348 msec 2023-09-24 20:01:06,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-24 20:01:06,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6e7e999c6c12fb69ae1b9cfe1e572cf4, server=jenkins-hbase4.apache.org,43375,1695585640237 in 189 msec 2023-09-24 20:01:06,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-24 20:01:06,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, ASSIGN in 353 msec 2023-09-24 20:01:06,121 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:01:06,121 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585666121"}]},"ts":"1695585666121"} 2023-09-24 20:01:06,122 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 20:01:06,125 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:01:06,126 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-24 20:01:06,128 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:01:06,129 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:06,129 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:06,129 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:06,129 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:06,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:06,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:06,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:06,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:06,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 438 msec 2023-09-24 20:01:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 20:01:06,307 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-24 20:01:06,310 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 20:01:06,310 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,313 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:06,322 DEBUG [hconnection-0x5a782b32-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:06,325 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:06,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:06,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585666331 (current time:1695585666331). 2023-09-24 20:01:06,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:06,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x15e6689d to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ce89179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:06,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:06,344 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15e6689d to 127.0.0.1:61864 2023-09-24 20:01:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:06,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x59a3efbc to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:06,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa7d695, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:06,354 DEBUG [hconnection-0x675ce341-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:06,355 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:06,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59a3efbc to 127.0.0.1:61864 2023-09-24 20:01:06,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:06,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:01:06,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:06,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:06,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:06,365 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:06,366 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695586266366 2023-09-24 20:01:06,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:06,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 20:01:06,367 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:06,367 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:06,369 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:06,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:06,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-24 20:01:06,371 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:06,372 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695586266372 2023-09-24 20:01:06,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,390 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-24 20:01:06,390 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:06,391 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 20:01:06,391 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 20:01:06,391 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,392 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,393 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,393 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,393 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,393 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,394 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,394 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,394 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,394 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:06,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,396 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:06,396 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:06,396 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:06,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:06,398 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:06,399 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:06,399 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:06,397 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:06,399 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:06,399 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:06,400 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:06,409 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,409 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,409 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,409 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,410 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@775db456[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:06,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 20:01:06,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@775db456[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:06,415 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 20:01:06,415 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,417 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,417 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:06,418 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:06,418 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:06,419 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,419 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:06,420 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:06,420 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:06,420 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:06,428 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:06,428 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,428 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. started... 2023-09-24 20:01:06,428 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. started... 2023-09-24 20:01:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f77f9191754148d3047b7f5c321d3ec: 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e7e999c6c12fb69ae1b9cfe1e572cf4: 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:06,430 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:06,450 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. completed. 2023-09-24 20:01:06,450 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:06,453 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:06,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 20:01:06,467 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:06,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:01:06,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:06,469 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:01:06,669 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:06,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:01:06,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:06,670 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-24 20:01:06,851 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. completed. 2023-09-24 20:01:06,851 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:06,851 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:06,851 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:06,851 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,851 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:06,851 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:06,853 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:06,853 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,853 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:06,853 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:06,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:06,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 20:01:06,858 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-24 20:01:06,859 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:06,859 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:06,859 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,859 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:06,861 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,861 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,861 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,861 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,862 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,861 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,862 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,863 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,863 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:06,865 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,866 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,866 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:06,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:06,869 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:06,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 20:01:06,869 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:06,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,870 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:06,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:06,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:06,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,872 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:01:06,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 20:01:06,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,908 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:06,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695585666366Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695585666881 (+515 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695585666881Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695585666881Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695585666885 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695585666897 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695585666908 (+11 ms) 2023-09-24 20:01:06,911 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:06,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 544 msec 2023-09-24 20:01:06,971 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:06,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:01:06,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:06,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:06,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:06,983 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 20:01:06,983 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:06,983 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:06,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585666995 (current time:1695585666995). 2023-09-24 20:01:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:06,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x3a4cc7d1 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:07,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fa8ce8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:07,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:07,009 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a4cc7d1 to 127.0.0.1:61864 2023-09-24 20:01:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:07,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x53ee3f79 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a884856, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:07,023 DEBUG [hconnection-0x43c07443-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:07,026 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:07,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ee3f79 to 127.0.0.1:61864 2023-09-24 20:01:07,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:07,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:01:07,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:07,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:07,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:07,037 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:07,038 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695586267038 2023-09-24 20:01:07,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 20:01:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:01:07,040 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:07,041 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:07,042 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:01:07,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:07,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-24 20:01:07,045 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:07,046 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695586267046 2023-09-24 20:01:07,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-24 20:01:07,065 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-24 20:01:07,065 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:07,067 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 20:01:07,067 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 20:01:07,068 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,068 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,070 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,069 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,070 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,071 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 20:01:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:07,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 20:01:07,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 20:01:07,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 20:01:07,076 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:07,076 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:07,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 20:01:07,076 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:07,076 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 20:01:07,077 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:07,077 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:07,078 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:07,076 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:07,077 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:07,079 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 20:01:07,081 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,081 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,081 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:07,083 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,083 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:07,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:07,083 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,083 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,083 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,084 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:07,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:07,084 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,084 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a48ac43[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:07,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:07,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 20:01:07,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a48ac43[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:07,088 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 20:01:07,088 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:07,090 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:01:07,091 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:07,091 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. started... 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:07,091 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e7e999c6c12fb69ae1b9cfe1e572cf4 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:07,091 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,091 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:07,091 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:07,091 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. started... 2023-09-24 20:01:07,092 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f77f9191754148d3047b7f5c321d3ec 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-24 20:01:07,093 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:07,093 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:07,093 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:07,130 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15 2023-09-24 20:01:07,140 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274 2023-09-24 20:01:07,141 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:07,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:01:07,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:07,146 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:01:07,152 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/.tmp/cf/580285b3a06242e4bd9222aa0f506e42 2023-09-24 20:01:07,160 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/.tmp/cf/580285b3a06242e4bd9222aa0f506e42 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42 2023-09-24 20:01:07,165 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/.tmp/cf/5437b1ff2f3a4b50b357ee96da6b560d 2023-09-24 20:01:07,168 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42, entries=3, sequenceid=6, filesize=5.4 K 2023-09-24 20:01:07,170 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6e7e999c6c12fb69ae1b9cfe1e572cf4 in 79ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:07,172 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e7e999c6c12fb69ae1b9cfe1e572cf4: 2023-09-24 20:01:07,172 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 20:01:07,172 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:07,172 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42] hfiles 2023-09-24 20:01:07,173 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42 for snapshot=snaptb0-testExportFileSystemState 2023-09-24 20:01:07,175 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/.tmp/cf/5437b1ff2f3a4b50b357ee96da6b560d as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d 2023-09-24 20:01:07,182 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d, entries=47, sequenceid=6, filesize=12.8 K 2023-09-24 20:01:07,183 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5f77f9191754148d3047b7f5c321d3ec in 92ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:07,183 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f77f9191754148d3047b7f5c321d3ec: 2023-09-24 20:01:07,183 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 20:01:07,183 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:07,183 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d] hfiles 2023-09-24 20:01:07,183 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d for snapshot=snaptb0-testExportFileSystemState 2023-09-24 20:01:07,193 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. completed. 2023-09-24 20:01:07,193 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:07,193 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:07,193 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:07,193 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,193 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:07,193 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:07,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:07,198 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:07,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:07,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 20:01:07,206 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. completed. 2023-09-24 20:01:07,206 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 20:01:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 20:01:07,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:07,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:07,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 20:01:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:07,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 20:01:07,215 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-24 20:01:07,215 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:07,215 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:07,215 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-24 20:01:07,215 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,217 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,218 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,218 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,221 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:07,221 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 20:01:07,222 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,226 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,226 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,226 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,226 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:07,226 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:07,226 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-24 20:01:07,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:07,228 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:07,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 20:01:07,228 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:07,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15] mob files 2023-09-24 20:01:07,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274 2023-09-24 20:01:07,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15 2023-09-24 20:01:07,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-24 20:01:07,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 20:01:07,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695585667039Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695585667239 (+200 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695585667239Loading Region manifests for snaptb0-testExportFileSystemState at 1695585667239Writing data manifest for snaptb0-testExportFileSystemState at 1695585667253 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695585667275 (+22 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695585667286 (+11 ms) 2023-09-24 20:01:07,290 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 20:01:07,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 250 msec 2023-09-24 20:01:07,347 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:07,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:01:07,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:07,348 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348 2023-09-24 20:01:07,349 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32847, tgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348, rawTgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:07,376 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:07,376 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1900712878_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,376 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-24 20:01:07,391 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 20:01:07,427 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:07,427 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:07,428 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:07,428 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,310 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-9073845990572150355.jar 2023-09-24 20:01:08,311 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,312 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,379 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-8569033757462877829.jar 2023-09-24 20:01:08,379 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,380 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,380 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,380 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,381 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,381 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:08,382 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:01:08,382 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:01:08,382 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:01:08,383 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:01:08,383 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:01:08,384 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:01:08,384 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:01:08,384 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:01:08,384 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:01:08,385 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:01:08,386 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:08,386 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:08,387 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:08,387 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:08,387 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:08,388 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:08,388 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:08,834 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:01:08,837 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-24 20:01:08,839 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 20:01:09,323 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:09,323 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:09,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0001_000001 (auth:SIMPLE) 2023-09-24 20:01:10,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0002_000001 (auth:SIMPLE) 2023-09-24 20:01:10,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:01:14,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0002_000001 (auth:SIMPLE) 2023-09-24 20:01:16,466 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0002_000001 (auth:SIMPLE) 2023-09-24 20:01:19,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0002_000001 (auth:SIMPLE) 2023-09-24 20:01:21,037 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:01:21,038 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:01:21,047 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-24 20:01:21,048 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:01:21,048 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:01:21,048 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 20:01:21,049 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 20:01:21,049 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 20:01:21,049 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 20:01:21,051 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 20:01:21,051 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585667348/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 20:01:21,059 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-24 20:01:21,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-24 20:01:21,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 20:01:21,065 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585681065"}]},"ts":"1695585681065"} 2023-09-24 20:01:21,067 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 20:01:21,069 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-24 20:01:21,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, UNASSIGN}] 2023-09-24 20:01:21,073 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, UNASSIGN 2023-09-24 20:01:21,073 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, UNASSIGN 2023-09-24 20:01:21,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f77f9191754148d3047b7f5c321d3ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:21,074 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6e7e999c6c12fb69ae1b9cfe1e572cf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:21,074 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585681074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585681074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585681074"}]},"ts":"1695585681074"} 2023-09-24 20:01:21,074 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585681073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585681073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585681073"}]},"ts":"1695585681073"} 2023-09-24 20:01:21,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6e7e999c6c12fb69ae1b9cfe1e572cf4, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:21,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 5f77f9191754148d3047b7f5c321d3ec, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:21,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 20:01:21,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:21,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f77f9191754148d3047b7f5c321d3ec, disabling compactions & flushes 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e7e999c6c12fb69ae1b9cfe1e572cf4, disabling compactions & flushes 2023-09-24 20:01:21,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:21,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. after waiting 0 ms 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. after waiting 0 ms 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:21,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:21,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:21,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:21,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:21,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:21,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4. 2023-09-24 20:01:21,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e7e999c6c12fb69ae1b9cfe1e572cf4: 2023-09-24 20:01:21,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec. 2023-09-24 20:01:21,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f77f9191754148d3047b7f5c321d3ec: 2023-09-24 20:01:21,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:21,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6e7e999c6c12fb69ae1b9cfe1e572cf4, regionState=CLOSED 2023-09-24 20:01:21,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:21,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585681245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585681245"}]},"ts":"1695585681245"} 2023-09-24 20:01:21,246 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f77f9191754148d3047b7f5c321d3ec, regionState=CLOSED 2023-09-24 20:01:21,246 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695585681245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585681245"}]},"ts":"1695585681245"} 2023-09-24 20:01:21,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-24 20:01:21,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6e7e999c6c12fb69ae1b9cfe1e572cf4, server=jenkins-hbase4.apache.org,43375,1695585640237 in 171 msec 2023-09-24 20:01:21,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-24 20:01:21,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 5f77f9191754148d3047b7f5c321d3ec, server=jenkins-hbase4.apache.org,37535,1695585640136 in 171 msec 2023-09-24 20:01:21,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f77f9191754148d3047b7f5c321d3ec, UNASSIGN in 180 msec 2023-09-24 20:01:21,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-24 20:01:21,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e7e999c6c12fb69ae1b9cfe1e572cf4, UNASSIGN in 180 msec 2023-09-24 20:01:21,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585681253"}]},"ts":"1695585681253"} 2023-09-24 20:01:21,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 20:01:21,257 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-24 20:01:21,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-09-24 20:01:21,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 20:01:21,368 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-24 20:01:21,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-24 20:01:21,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,372 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-24 20:01:21,373 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,375 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-24 20:01:21,378 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:21,378 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:21,380 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/recovered.edits] 2023-09-24 20:01:21,380 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/recovered.edits] 2023-09-24 20:01:21,381 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,381 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,381 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,381 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 20:01:21,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 20:01:21,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 20:01:21,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,383 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 20:01:21,386 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/cf/5437b1ff2f3a4b50b357ee96da6b560d 2023-09-24 20:01:21,387 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/cf/580285b3a06242e4bd9222aa0f506e42 2023-09-24 20:01:21,389 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec/recovered.edits/9.seqid 2023-09-24 20:01:21,390 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4/recovered.edits/9.seqid 2023-09-24 20:01:21,390 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/5f77f9191754148d3047b7f5c321d3ec 2023-09-24 20:01:21,390 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemState/6e7e999c6c12fb69ae1b9cfe1e572cf4 2023-09-24 20:01:21,390 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 20:01:21,391 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 20:01:21,391 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-24 20:01:21,395 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924a2f991bf6629441abaa445b25f993274 2023-09-24 20:01:21,396 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924091bbe9ac68f4061a9fc0d818df3bd15 2023-09-24 20:01:21,396 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 20:01:21,399 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,401 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-24 20:01:21,403 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-24 20:01:21,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-24 20:01:21,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585681404"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:21,405 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585681404"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:21,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:01:21,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e7e999c6c12fb69ae1b9cfe1e572cf4, NAME => 'testtb-testExportFileSystemState,,1695585665693.6e7e999c6c12fb69ae1b9cfe1e572cf4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5f77f9191754148d3047b7f5c321d3ec, NAME => 'testtb-testExportFileSystemState,1,1695585665693.5f77f9191754148d3047b7f5c321d3ec.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:01:21,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-24 20:01:21,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585681407"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:21,408 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-24 20:01:21,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 20:01:21,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-09-24 20:01:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 20:01:21,485 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-24 20:01:21,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-24 20:01:21,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-24 20:01:21,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-24 20:01:21,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-24 20:01:21,523 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=770 (was 758) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:42783 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:55522 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_914259963_1 at /127.0.0.1:55504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_914259963_1 at /127.0.0.1:45346 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:45366 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:60966 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:39171 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x289a8375-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 931) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 213) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7674 (was 7809) 2023-09-24 20:01:21,524 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-24 20:01:21,543 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=168, AvailableMemoryMB=7673 2023-09-24 20:01:21,544 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-09-24 20:01:21,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:01:21,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:21,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:01:21,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-24 20:01:21,551 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:01:21,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 20:01:21,553 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,556 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 empty. 2023-09-24 20:01:21,556 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,556 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,557 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 empty. 2023-09-24 20:01:21,567 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 20:01:21,578 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-24 20:01:21,579 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 86b522d2f50e543d038f71016283d795, NAME => 'testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:21,580 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => d3707e937faf67c1576668292615c003, NAME => 'testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 86b522d2f50e543d038f71016283d795, disabling compactions & flushes 2023-09-24 20:01:21,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. after waiting 0 ms 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing d3707e937faf67c1576668292615c003, disabling compactions & flushes 2023-09-24 20:01:21,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 86b522d2f50e543d038f71016283d795: 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. after waiting 0 ms 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for d3707e937faf67c1576668292615c003: 2023-09-24 20:01:21,598 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:01:21,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585681599"}]},"ts":"1695585681599"} 2023-09-24 20:01:21,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585681599"}]},"ts":"1695585681599"} 2023-09-24 20:01:21,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:01:21,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:01:21,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585681603"}]},"ts":"1695585681603"} 2023-09-24 20:01:21,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-24 20:01:21,609 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:01:21,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:01:21,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:01:21,611 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:01:21,611 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:01:21,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, ASSIGN}] 2023-09-24 20:01:21,614 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, ASSIGN 2023-09-24 20:01:21,614 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, ASSIGN 2023-09-24 20:01:21,615 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:01:21,615 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37535,1695585640136; forceNewPlan=false, retain=false 2023-09-24 20:01:21,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 20:01:21,766 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:01:21,768 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86b522d2f50e543d038f71016283d795, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:21,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d3707e937faf67c1576668292615c003, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:21,769 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585681768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585681768"}]},"ts":"1695585681768"} 2023-09-24 20:01:21,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585681768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585681768"}]},"ts":"1695585681768"} 2023-09-24 20:01:21,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 86b522d2f50e543d038f71016283d795, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:21,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure d3707e937faf67c1576668292615c003, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 20:01:21,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86b522d2f50e543d038f71016283d795, NAME => 'testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:01:21,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. service=AccessControlService 2023-09-24 20:01:21,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3707e937faf67c1576668292615c003, NAME => 'testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:01:21,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. service=AccessControlService 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:21,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,929 INFO [StoreOpener-86b522d2f50e543d038f71016283d795-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,929 INFO [StoreOpener-d3707e937faf67c1576668292615c003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,930 DEBUG [StoreOpener-86b522d2f50e543d038f71016283d795-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf 2023-09-24 20:01:21,930 DEBUG [StoreOpener-d3707e937faf67c1576668292615c003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf 2023-09-24 20:01:21,930 DEBUG [StoreOpener-86b522d2f50e543d038f71016283d795-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf 2023-09-24 20:01:21,930 DEBUG [StoreOpener-d3707e937faf67c1576668292615c003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf 2023-09-24 20:01:21,931 INFO [StoreOpener-86b522d2f50e543d038f71016283d795-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86b522d2f50e543d038f71016283d795 columnFamilyName cf 2023-09-24 20:01:21,931 INFO [StoreOpener-d3707e937faf67c1576668292615c003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3707e937faf67c1576668292615c003 columnFamilyName cf 2023-09-24 20:01:21,932 INFO [StoreOpener-d3707e937faf67c1576668292615c003-1] regionserver.HStore(310): Store=d3707e937faf67c1576668292615c003/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:21,932 INFO [StoreOpener-86b522d2f50e543d038f71016283d795-1] regionserver.HStore(310): Store=86b522d2f50e543d038f71016283d795/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:21,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3707e937faf67c1576668292615c003 2023-09-24 20:01:21,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:21,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:21,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:21,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 86b522d2f50e543d038f71016283d795; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70918023, jitterRate=0.056760892271995544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:21,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 86b522d2f50e543d038f71016283d795: 2023-09-24 20:01:21,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3707e937faf67c1576668292615c003; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67919943, jitterRate=0.012086018919944763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:21,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3707e937faf67c1576668292615c003: 2023-09-24 20:01:21,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795., pid=45, masterSystemTime=1695585681922 2023-09-24 20:01:21,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003., pid=46, masterSystemTime=1695585681923 2023-09-24 20:01:21,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:21,942 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=86b522d2f50e543d038f71016283d795, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:21,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585681942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585681942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585681942"}]},"ts":"1695585681942"} 2023-09-24 20:01:21,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:21,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d3707e937faf67c1576668292615c003, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:21,943 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585681943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585681943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585681943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585681943"}]},"ts":"1695585681943"} 2023-09-24 20:01:21,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-24 20:01:21,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 86b522d2f50e543d038f71016283d795, server=jenkins-hbase4.apache.org,37535,1695585640136 in 173 msec 2023-09-24 20:01:21,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-24 20:01:21,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure d3707e937faf67c1576668292615c003, server=jenkins-hbase4.apache.org,43375,1695585640237 in 173 msec 2023-09-24 20:01:21,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, ASSIGN in 335 msec 2023-09-24 20:01:21,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-24 20:01:21,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, ASSIGN in 336 msec 2023-09-24 20:01:21,950 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:01:21,950 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585681950"}]},"ts":"1695585681950"} 2023-09-24 20:01:21,951 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-24 20:01:21,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:01:21,954 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-24 20:01:21,956 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 20:01:21,957 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,957 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,957 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,957 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:21,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 414 msec 2023-09-24 20:01:22,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 20:01:22,155 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-24 20:01:22,157 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 20:01:22,158 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,159 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:22,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585682171 (current time:1695585682171). 2023-09-24 20:01:22,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:22,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x5cd1f469 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:22,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2d5a19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:22,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:22,184 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:22,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cd1f469 to 127.0.0.1:61864 2023-09-24 20:01:22,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:22,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x67e1713e to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:22,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3440b317, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:22,195 DEBUG [hconnection-0x737aca14-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:22,198 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:22,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67e1713e to 127.0.0.1:61864 2023-09-24 20:01:22,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:22,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 20:01:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,208 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,209 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695586282208 2023-09-24 20:01:22,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,209 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 20:01:22,210 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:22,210 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:22,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,213 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-24 20:01:22,216 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,216 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695586282216 2023-09-24 20:01:22,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,227 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-24 20:01:22,227 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,229 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 20:01:22,229 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 20:01:22,229 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,230 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,231 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,231 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,231 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,231 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,232 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,232 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,233 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,233 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,234 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,234 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 20:01:22,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,241 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,241 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,242 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,242 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,242 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,242 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,246 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,246 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,246 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,248 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,248 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,248 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,248 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,249 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fcb5b44[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 20:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fcb5b44[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:22,253 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 20:01:22,253 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,254 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,254 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,254 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,255 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,255 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:22,255 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:22,255 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. started... 2023-09-24 20:01:22,255 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:22,255 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. started... 2023-09-24 20:01:22,255 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d3707e937faf67c1576668292615c003: 2023-09-24 20:01:22,256 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86b522d2f50e543d038f71016283d795: 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:22,257 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:22,264 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,264 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,264 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,277 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. completed. 2023-09-24 20:01:22,277 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:22,279 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,279 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,279 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,279 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,281 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. completed. 2023-09-24 20:01:22,281 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,281 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:22,281 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:22,281 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,281 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,281 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,283 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,283 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:22,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 20:01:22,291 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-24 20:01:22,291 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:22,291 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:22,291 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,291 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,293 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,294 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,295 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,297 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,297 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,297 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,302 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,301 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,302 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,303 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,303 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,304 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:01:22,310 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:22,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 20:01:22,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:22,312 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:01:22,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,331 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 20:01:22,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,332 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:22,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695585682209Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695585682313 (+104 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695585682313Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695585682313Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695585682317 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695585682325 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695585682331 (+6 ms) 2023-09-24 20:01:22,335 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 125 msec 2023-09-24 20:01:22,512 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:22,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 20:01:22,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:22,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:22,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:22,521 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 20:01:22,521 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,521 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:22,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585682532 (current time:1695585682532). 2023-09-24 20:01:22,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:22,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x08f4fdcb to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:22,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2da070cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:22,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:22,550 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:22,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08f4fdcb to 127.0.0.1:61864 2023-09-24 20:01:22,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:22,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x7230ac0e to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:22,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d050d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:22,559 DEBUG [hconnection-0x730d1865-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:22,560 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:22,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7230ac0e to 127.0.0.1:61864 2023-09-24 20:01:22,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:22,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 20:01:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,570 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,571 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695586282571 2023-09-24 20:01:22,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 20:01:22,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 20:01:22,572 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:22,573 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:22,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,574 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 20:01:22,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-24 20:01:22,577 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,577 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695586282577 2023-09-24 20:01:22,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-24 20:01:22,590 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-24 20:01:22,590 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,592 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 20:01:22,592 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 20:01:22,593 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,593 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,594 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,595 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,595 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,595 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,595 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 20:01:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 20:01:22,597 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,596 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,600 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 20:01:22,601 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 20:01:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,602 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,602 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,603 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:22,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@973a78[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 20:01:22,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@973a78[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:22,609 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 20:01:22,609 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:22,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,612 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,612 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,611 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 20:01:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:22,613 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:22,613 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. started... 2023-09-24 20:01:22,613 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d3707e937faf67c1576668292615c003 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-24 20:01:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,614 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,616 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:22,617 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:22,618 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,618 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. started... 2023-09-24 20:01:22,618 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 86b522d2f50e543d038f71016283d795 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-24 20:01:22,641 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e 2023-09-24 20:01:22,642 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0 2023-09-24 20:01:22,650 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/.tmp/cf/feb456fecff4491a9998578cfeadc554 2023-09-24 20:01:22,651 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/.tmp/cf/44cfa338ab74404cb40bf81885deef74 2023-09-24 20:01:22,660 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/.tmp/cf/44cfa338ab74404cb40bf81885deef74 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74 2023-09-24 20:01:22,660 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/.tmp/cf/feb456fecff4491a9998578cfeadc554 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554 2023-09-24 20:01:22,665 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554, entries=1, sequenceid=6, filesize=5.1 K 2023-09-24 20:01:22,666 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74, entries=49, sequenceid=6, filesize=13.0 K 2023-09-24 20:01:22,666 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 86b522d2f50e543d038f71016283d795 in 48ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:22,666 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-24 20:01:22,666 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for d3707e937faf67c1576668292615c003 in 53ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:22,667 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86b522d2f50e543d038f71016283d795: 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d3707e937faf67c1576668292615c003: 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:22,668 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:22,669 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74] hfiles 2023-09-24 20:01:22,669 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554] hfiles 2023-09-24 20:01:22,669 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554 for snapshot=snaptb0-testConsecutiveExports 2023-09-24 20:01:22,669 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74 for snapshot=snaptb0-testConsecutiveExports 2023-09-24 20:01:22,673 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:22,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 20:01:22,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:22,674 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:01:22,676 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. completed. 2023-09-24 20:01:22,676 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:22,677 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. completed. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,677 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 20:01:22,677 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:22,679 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,679 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 20:01:22,679 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,679 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,679 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,679 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,679 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,680 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 20:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:22,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 20:01:22,688 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-24 20:01:22,688 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:22,688 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:22,688 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-24 20:01:22,688 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,690 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,691 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,691 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,691 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:22,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,693 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,694 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:22,694 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 20:01:22,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:22,702 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-24 20:01:22,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,704 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 20:01:22,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,702 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:22,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 20:01:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:22,704 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:22,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,704 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:22,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,705 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e] mob files 2023-09-24 20:01:22,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0 2023-09-24 20:01:22,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e 2023-09-24 20:01:22,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-24 20:01:22,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 20:01:22,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,739 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695585682571Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695585682719 (+148 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695585682719Loading Region manifests for snaptb0-testConsecutiveExports at 1695585682719Writing data manifest for snaptb0-testConsecutiveExports at 1695585682723 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695585682730 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695585682738 (+8 ms) 2023-09-24 20:01:22,741 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 20:01:22,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 169 msec 2023-09-24 20:01:22,875 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:22,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 20:01:22,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:22,876 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876 2023-09-24 20:01:22,876 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:22,906 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:22,906 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@12964bc2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,906 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 20:01:22,915 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:22,927 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:22,928 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:22,928 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:22,929 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,817 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-2330016226103604642.jar 2023-09-24 20:01:23,817 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,817 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,884 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-6858068802517861827.jar 2023-09-24 20:01:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,885 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,886 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:01:23,887 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:01:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:01:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:01:23,888 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:01:23,889 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:01:23,890 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:01:23,890 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:01:23,891 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:01:23,892 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:01:23,893 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:23,893 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:23,894 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:23,895 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:23,895 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:23,896 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:23,897 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:24,277 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:01:24,280 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 20:01:24,282 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 20:01:25,852 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:25,852 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:25,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0002_000001 (auth:SIMPLE) 2023-09-24 20:01:26,651 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0003_000001 (auth:SIMPLE) 2023-09-24 20:01:26,823 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:01:30,490 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0003_000001 (auth:SIMPLE) 2023-09-24 20:01:32,709 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0003_000001 (auth:SIMPLE) 2023-09-24 20:01:35,065 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0003_000001 (auth:SIMPLE) 2023-09-24 20:01:36,453 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:01:36,454 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:01:36,458 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 20:01:36,458 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:01:36,459 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:01:36,459 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 20:01:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 20:01:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 20:01:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e901656 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 20:01:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 20:01:36,462 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 20:01:36,463 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:36,485 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:36,485 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@70d38673, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:36,485 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 20:01:36,499 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 20:01:36,511 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:36,512 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:36,512 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:36,512 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,402 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-1758178546670398705.jar 2023-09-24 20:01:37,403 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,403 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,469 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-3926500311628407427.jar 2023-09-24 20:01:37,470 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,470 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,471 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,471 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,471 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,472 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:37,472 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:01:37,472 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:01:37,473 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:01:37,473 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:01:37,474 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:01:37,474 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:01:37,474 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:01:37,475 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:01:37,475 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:01:37,476 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:01:37,476 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:37,477 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:37,477 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:37,477 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:37,478 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:37,478 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:37,479 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:37,832 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:01:37,834 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 20:01:37,836 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 20:01:41,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:41,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:41,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0003_000001 (auth:SIMPLE) 2023-09-24 20:01:41,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0004_000001 (auth:SIMPLE) 2023-09-24 20:01:45,591 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0004_000001 (auth:SIMPLE) 2023-09-24 20:01:47,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0004_000001 (auth:SIMPLE) 2023-09-24 20:01:50,096 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0004_000001 (auth:SIMPLE) 2023-09-24 20:01:52,019 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:01:52,019 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:01:52,022 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 20:01:52,022 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:01:52,023 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:01:52,023 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 20:01:52,026 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 20:01:52,026 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 20:01:52,027 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e901656 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 20:01:52,027 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 20:01:52,027 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/local-export-1695585682876/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 20:01:52,039 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-24 20:01:52,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-24 20:01:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 20:01:52,044 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585712044"}]},"ts":"1695585712044"} 2023-09-24 20:01:52,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-24 20:01:52,047 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-24 20:01:52,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, UNASSIGN}] 2023-09-24 20:01:52,049 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, UNASSIGN 2023-09-24 20:01:52,050 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, UNASSIGN 2023-09-24 20:01:52,050 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=86b522d2f50e543d038f71016283d795, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:52,050 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d3707e937faf67c1576668292615c003, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:52,050 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585712050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585712050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585712050"}]},"ts":"1695585712050"} 2023-09-24 20:01:52,050 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585712050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585712050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585712050"}]},"ts":"1695585712050"} 2023-09-24 20:01:52,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 86b522d2f50e543d038f71016283d795, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:52,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure d3707e937faf67c1576668292615c003, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:52,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 20:01:52,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:52,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 86b522d2f50e543d038f71016283d795, disabling compactions & flushes 2023-09-24 20:01:52,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:52,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:52,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. after waiting 0 ms 2023-09-24 20:01:52,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:52,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d3707e937faf67c1576668292615c003 2023-09-24 20:01:52,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3707e937faf67c1576668292615c003, disabling compactions & flushes 2023-09-24 20:01:52,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:52,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:52,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. after waiting 0 ms 2023-09-24 20:01:52,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:01:52,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:52,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:52,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795. 2023-09-24 20:01:52,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003. 2023-09-24 20:01:52,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 86b522d2f50e543d038f71016283d795: 2023-09-24 20:01:52,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3707e937faf67c1576668292615c003: 2023-09-24 20:01:52,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 86b522d2f50e543d038f71016283d795 2023-09-24 20:01:52,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=86b522d2f50e543d038f71016283d795, regionState=CLOSED 2023-09-24 20:01:52,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d3707e937faf67c1576668292615c003 2023-09-24 20:01:52,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585712224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585712224"}]},"ts":"1695585712224"} 2023-09-24 20:01:52,225 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d3707e937faf67c1576668292615c003, regionState=CLOSED 2023-09-24 20:01:52,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695585712225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585712225"}]},"ts":"1695585712225"} 2023-09-24 20:01:52,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-24 20:01:52,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 86b522d2f50e543d038f71016283d795, server=jenkins-hbase4.apache.org,37535,1695585640136 in 174 msec 2023-09-24 20:01:52,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-24 20:01:52,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure d3707e937faf67c1576668292615c003, server=jenkins-hbase4.apache.org,43375,1695585640237 in 174 msec 2023-09-24 20:01:52,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=86b522d2f50e543d038f71016283d795, UNASSIGN in 180 msec 2023-09-24 20:01:52,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-24 20:01:52,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d3707e937faf67c1576668292615c003, UNASSIGN in 181 msec 2023-09-24 20:01:52,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585712231"}]},"ts":"1695585712231"} 2023-09-24 20:01:52,232 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-24 20:01:52,234 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-24 20:01:52,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-09-24 20:01:52,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 20:01:52,346 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-24 20:01:52,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-24 20:01:52,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,350 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-24 20:01:52,351 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,354 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-24 20:01:52,357 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:52,357 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:52,358 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,359 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,359 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,358 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 20:01:52,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 20:01:52,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 20:01:52,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 20:01:52,359 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/recovered.edits] 2023-09-24 20:01:52,360 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/recovered.edits] 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 20:01:52,360 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 20:01:52,364 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/cf/feb456fecff4491a9998578cfeadc554 2023-09-24 20:01:52,364 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/cf/44cfa338ab74404cb40bf81885deef74 2023-09-24 20:01:52,367 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795/recovered.edits/9.seqid 2023-09-24 20:01:52,367 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003/recovered.edits/9.seqid 2023-09-24 20:01:52,368 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/86b522d2f50e543d038f71016283d795 2023-09-24 20:01:52,368 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testConsecutiveExports/d3707e937faf67c1576668292615c003 2023-09-24 20:01:52,368 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 20:01:52,368 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 20:01:52,369 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-24 20:01:52,372 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230924b9cccb042deb49cab1eeae34247a41a0 2023-09-24 20:01:52,374 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230924f27ca9e21e98442d9ca8f90ec33fdb5e 2023-09-24 20:01:52,374 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 20:01:52,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,379 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-24 20:01:52,381 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-24 20:01:52,382 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,382 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-24 20:01:52,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585712382"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:52,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585712382"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:52,383 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:01:52,384 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 86b522d2f50e543d038f71016283d795, NAME => 'testtb-testConsecutiveExports,,1695585681545.86b522d2f50e543d038f71016283d795.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d3707e937faf67c1576668292615c003, NAME => 'testtb-testConsecutiveExports,1,1695585681545.d3707e937faf67c1576668292615c003.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:01:52,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-24 20:01:52,384 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585712384"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:52,385 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-24 20:01:52,387 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 20:01:52,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 40 msec 2023-09-24 20:01:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 20:01:52,462 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-24 20:01:52,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-24 20:01:52,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-24 20:01:52,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-24 20:01:52,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-24 20:01:52,496 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 770), OpenFileDescriptor=897 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 216), ProcessCount=168 (was 168), AvailableMemoryMB=7561 (was 7673) 2023-09-24 20:01:52,496 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-24 20:01:52,515 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=168, AvailableMemoryMB=7598 2023-09-24 20:01:52,515 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-24 20:01:52,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:01:52,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:52,520 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:01:52,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-24 20:01:52,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:01:52,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 20:01:52,523 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,523 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,524 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 empty. 2023-09-24 20:01:52,524 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 empty. 2023-09-24 20:01:52,524 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,524 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 20:01:52,534 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-24 20:01:52,535 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3783ed26213aca60b7d55743ddafcd49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:52,535 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 62a42d99dd145f775826297af9f451c9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:52,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3783ed26213aca60b7d55743ddafcd49, disabling compactions & flushes 2023-09-24 20:01:52,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. after waiting 0 ms 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 62a42d99dd145f775826297af9f451c9, disabling compactions & flushes 2023-09-24 20:01:52,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3783ed26213aca60b7d55743ddafcd49: 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. after waiting 0 ms 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 62a42d99dd145f775826297af9f451c9: 2023-09-24 20:01:52,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:01:52,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585712546"}]},"ts":"1695585712546"} 2023-09-24 20:01:52,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585712546"}]},"ts":"1695585712546"} 2023-09-24 20:01:52,552 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:01:52,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:01:52,553 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585712553"}]},"ts":"1695585712553"} 2023-09-24 20:01:52,554 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-24 20:01:52,558 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:01:52,559 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:01:52,559 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:01:52,559 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:01:52,559 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:01:52,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, ASSIGN}] 2023-09-24 20:01:52,562 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, ASSIGN 2023-09-24 20:01:52,562 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, ASSIGN 2023-09-24 20:01:52,563 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:01:52,563 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37535,1695585640136; forceNewPlan=false, retain=false 2023-09-24 20:01:52,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 20:01:52,713 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:01:52,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3783ed26213aca60b7d55743ddafcd49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:52,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=62a42d99dd145f775826297af9f451c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:52,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585712716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585712716"}]},"ts":"1695585712716"} 2023-09-24 20:01:52,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585712716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585712716"}]},"ts":"1695585712716"} 2023-09-24 20:01:52,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 62a42d99dd145f775826297af9f451c9, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:52,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 3783ed26213aca60b7d55743ddafcd49, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:01:52,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 20:01:52,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62a42d99dd145f775826297af9f451c9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:01:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3783ed26213aca60b7d55743ddafcd49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:01:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. service=AccessControlService 2023-09-24 20:01:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. service=AccessControlService 2023-09-24 20:01:52,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:52,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,877 INFO [StoreOpener-3783ed26213aca60b7d55743ddafcd49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,877 INFO [StoreOpener-62a42d99dd145f775826297af9f451c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,879 DEBUG [StoreOpener-3783ed26213aca60b7d55743ddafcd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf 2023-09-24 20:01:52,879 DEBUG [StoreOpener-3783ed26213aca60b7d55743ddafcd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf 2023-09-24 20:01:52,879 DEBUG [StoreOpener-62a42d99dd145f775826297af9f451c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf 2023-09-24 20:01:52,879 DEBUG [StoreOpener-62a42d99dd145f775826297af9f451c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf 2023-09-24 20:01:52,879 INFO [StoreOpener-3783ed26213aca60b7d55743ddafcd49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3783ed26213aca60b7d55743ddafcd49 columnFamilyName cf 2023-09-24 20:01:52,879 INFO [StoreOpener-62a42d99dd145f775826297af9f451c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62a42d99dd145f775826297af9f451c9 columnFamilyName cf 2023-09-24 20:01:52,881 INFO [StoreOpener-62a42d99dd145f775826297af9f451c9-1] regionserver.HStore(310): Store=62a42d99dd145f775826297af9f451c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:52,881 INFO [StoreOpener-3783ed26213aca60b7d55743ddafcd49-1] regionserver.HStore(310): Store=3783ed26213aca60b7d55743ddafcd49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:52,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62a42d99dd145f775826297af9f451c9 2023-09-24 20:01:52,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:01:52,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:52,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:52,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62a42d99dd145f775826297af9f451c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69277119, jitterRate=0.03230951726436615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:52,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3783ed26213aca60b7d55743ddafcd49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66468974, jitterRate=-0.009535104036331177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:52,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62a42d99dd145f775826297af9f451c9: 2023-09-24 20:01:52,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3783ed26213aca60b7d55743ddafcd49: 2023-09-24 20:01:52,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49., pid=61, masterSystemTime=1695585712871 2023-09-24 20:01:52,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9., pid=60, masterSystemTime=1695585712871 2023-09-24 20:01:52,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:52,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3783ed26213aca60b7d55743ddafcd49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:52,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:52,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585712892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585712892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585712892"}]},"ts":"1695585712892"} 2023-09-24 20:01:52,893 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=62a42d99dd145f775826297af9f451c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:52,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585712893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585712893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585712893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585712893"}]},"ts":"1695585712893"} 2023-09-24 20:01:52,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-24 20:01:52,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 3783ed26213aca60b7d55743ddafcd49, server=jenkins-hbase4.apache.org,37535,1695585640136 in 175 msec 2023-09-24 20:01:52,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-24 20:01:52,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 62a42d99dd145f775826297af9f451c9, server=jenkins-hbase4.apache.org,43375,1695585640237 in 177 msec 2023-09-24 20:01:52,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, ASSIGN in 337 msec 2023-09-24 20:01:52,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-24 20:01:52,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, ASSIGN in 338 msec 2023-09-24 20:01:52,900 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:01:52,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585712900"}]},"ts":"1695585712900"} 2023-09-24 20:01:52,902 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-24 20:01:52,904 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:01:52,904 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-24 20:01:52,906 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 20:01:52,908 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,908 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,908 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,908 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:52,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:52,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:52,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:52,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:52,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 393 msec 2023-09-24 20:01:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 20:01:53,125 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-24 20:01:53,127 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,128 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,129 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:53,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585713142 (current time:1695585713142). 2023-09-24 20:01:53,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:53,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x7a748069 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@482bff4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:53,158 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:53,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a748069 to 127.0.0.1:61864 2023-09-24 20:01:53,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:53,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x53bad905 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:53,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d136cd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:53,166 DEBUG [hconnection-0x1a550394-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:53,169 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53bad905 to 127.0.0.1:61864 2023-09-24 20:01:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:53,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 20:01:53,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:53,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,178 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,178 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695586313178 2023-09-24 20:01:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,180 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:53,180 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:53,181 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-24 20:01:53,183 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,183 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695586313183 2023-09-24 20:01:53,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,192 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 20:01:53,192 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,193 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 20:01:53,193 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 20:01:53,194 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,194 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,195 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,196 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,196 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,196 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,197 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,197 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,198 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,198 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,198 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,198 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,200 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,202 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,202 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,203 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,203 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1af2d138[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 20:01:53,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1af2d138[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:53,207 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 20:01:53,207 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,208 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,209 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:53,209 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:53,209 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. started... 2023-09-24 20:01:53,209 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:53,209 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:53,209 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:53,209 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. started... 2023-09-24 20:01:53,209 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3783ed26213aca60b7d55743ddafcd49: 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62a42d99dd145f775826297af9f451c9: 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:53,211 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:01:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,225 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. completed. 2023-09-24 20:01:53,226 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:53,226 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. completed. 2023-09-24 20:01:53,226 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:53,226 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:53,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,228 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,229 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,229 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:53,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 20:01:53,237 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 20:01:53,237 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:53,237 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:53,237 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,237 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:53,238 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,238 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,238 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,238 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,238 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,239 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,239 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,240 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,241 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,242 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,243 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,243 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,247 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,246 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,247 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,247 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,247 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,247 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,247 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:01:53,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 20:01:53,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,275 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695585713179Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695585713256 (+77 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695585713256Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695585713257 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695585713260 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695585713269 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695585713275 (+6 ms) 2023-09-24 20:01:53,278 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 98 msec 2023-09-24 20:01:53,281 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:53,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 20:01:53,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:53,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:53,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:01:53,288 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,288 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,288 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:01:53,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585713299 (current time:1695585713299). 2023-09-24 20:01:53,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:53,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x0d51edbe to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:53,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51a3c89f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:53,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:53,309 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:53,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d51edbe to 127.0.0.1:61864 2023-09-24 20:01:53,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:53,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x5beaf344 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:53,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59d4c99a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:53,319 DEBUG [hconnection-0x16fc050f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:53,322 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:53,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5beaf344 to 127.0.0.1:61864 2023-09-24 20:01:53,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:53,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 20:01:53,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:53,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,331 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,332 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695586313332 2023-09-24 20:01:53,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 20:01:53,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,333 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:53,334 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:53,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,335 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 20:01:53,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-24 20:01:53,337 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,337 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695586313337 2023-09-24 20:01:53,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,348 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 20:01:53,348 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,350 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 20:01:53,350 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 20:01:53,350 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,350 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,352 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,352 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,352 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,353 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,353 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,353 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:53,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,355 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 20:01:53,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,355 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,355 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,355 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,356 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,355 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,359 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 20:01:53,359 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 20:01:53,359 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 20:01:53,361 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,361 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,361 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,361 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,362 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55174c91[Count = 1] remaining members to acquire global barrier 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 20:01:53,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55174c91[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:53,367 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 20:01:53,367 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,370 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,370 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. started... 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:53,370 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:53,371 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:53,370 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3783ed26213aca60b7d55743ddafcd49 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-24 20:01:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:53,371 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:53,371 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. started... 2023-09-24 20:01:53,371 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 62a42d99dd145f775826297af9f451c9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-24 20:01:53,372 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,373 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,373 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,391 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24 2023-09-24 20:01:53,391 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e 2023-09-24 20:01:53,399 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/.tmp/cf/1182ad9f786241d299fa0851c42dad55 2023-09-24 20:01:53,399 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/.tmp/cf/e67c9cf8a5624eb8a8d35c695e60b8cd 2023-09-24 20:01:53,404 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/.tmp/cf/e67c9cf8a5624eb8a8d35c695e60b8cd as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd 2023-09-24 20:01:53,404 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/.tmp/cf/1182ad9f786241d299fa0851c42dad55 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55 2023-09-24 20:01:53,408 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd, entries=48, sequenceid=6, filesize=13.7 K 2023-09-24 20:01:53,409 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55, entries=2, sequenceid=6, filesize=5.3 K 2023-09-24 20:01:53,409 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3783ed26213aca60b7d55743ddafcd49 in 39ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:53,410 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 62a42d99dd145f775826297af9f451c9 in 38ms, sequenceid=6, compaction requested=false 2023-09-24 20:01:53,410 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 20:01:53,410 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 20:01:53,413 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3783ed26213aca60b7d55743ddafcd49: 2023-09-24 20:01:53,413 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62a42d99dd145f775826297af9f451c9: 2023-09-24 20:01:53,413 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55] hfiles 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd] hfiles 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,414 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,421 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. completed. 2023-09-24 20:01:53,421 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:01:53,421 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:53,421 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:53,421 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,421 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,421 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:53,422 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. completed. 2023-09-24 20:01:53,422 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:01:53,422 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:53,422 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:53,422 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,422 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 20:01:53,422 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:53,423 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,423 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,423 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,423 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,425 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,425 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 20:01:53,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,425 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,426 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 20:01:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:01:53,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 20:01:53,432 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 20:01:53,432 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:53,432 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:53,432 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,433 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:53,434 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:53,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 20:01:53,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:01:53,435 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:53,440 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,439 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,440 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,440 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:53,442 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,442 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,442 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,445 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:53,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,447 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,447 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:53,445 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:53,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,447 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,447 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,447 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:01:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:53,448 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,448 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:53,448 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,448 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e] mob files 2023-09-24 20:01:53,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24 2023-09-24 20:01:53,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e 2023-09-24 20:01:53,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 20:01:53,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,477 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:01:53,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695585713332Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695585713457 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695585713457Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695585713457Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695585713460 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695585713469 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695585713476 (+7 ms) 2023-09-24 20:01:53,479 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 20:01:53,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 146 msec 2023-09-24 20:01:53,635 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 20:01:53,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:53,665 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:01:53,668 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:01:53,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 20:01:53,670 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:01:53,675 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:01:53,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 20:01:53,676 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 20:01:53,679 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 20:01:53,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 20:01:53,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 20:01:53,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:53,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:01:53,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-24 20:01:53,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:01:53,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 20:01:53,688 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:53,688 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:53,689 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 empty. 2023-09-24 20:01:53,689 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 empty. 2023-09-24 20:01:53,689 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:53,689 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:53,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 20:01:53,699 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-24 20:01:53,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c21c20f9d936ffd7e80e3b09d71b4458, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:53,703 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4b8a4394b4dc6c0d22f547d578c8c773, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:01:53,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4b8a4394b4dc6c0d22f547d578c8c773, disabling compactions & flushes 2023-09-24 20:01:53,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. after waiting 0 ms 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:53,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4b8a4394b4dc6c0d22f547d578c8c773: 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing c21c20f9d936ffd7e80e3b09d71b4458, disabling compactions & flushes 2023-09-24 20:01:53,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. after waiting 0 ms 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:53,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:53,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for c21c20f9d936ffd7e80e3b09d71b4458: 2023-09-24 20:01:53,713 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:01:53,714 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585713714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585713714"}]},"ts":"1695585713714"} 2023-09-24 20:01:53,714 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585713714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585713714"}]},"ts":"1695585713714"} 2023-09-24 20:01:53,716 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:01:53,717 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:01:53,717 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585713717"}]},"ts":"1695585713717"} 2023-09-24 20:01:53,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-24 20:01:53,722 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:01:53,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:01:53,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:01:53,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:01:53,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:01:53,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, ASSIGN}] 2023-09-24 20:01:53,726 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, ASSIGN 2023-09-24 20:01:53,726 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, ASSIGN 2023-09-24 20:01:53,727 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:01:53,727 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:01:53,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 20:01:53,877 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:01:53,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4b8a4394b4dc6c0d22f547d578c8c773, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:53,880 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c21c20f9d936ffd7e80e3b09d71b4458, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:53,880 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585713880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585713880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585713880"}]},"ts":"1695585713880"} 2023-09-24 20:01:53,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585713880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585713880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585713880"}]},"ts":"1695585713880"} 2023-09-24 20:01:53,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 4b8a4394b4dc6c0d22f547d578c8c773, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:53,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure c21c20f9d936ffd7e80e3b09d71b4458, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:01:53,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 20:01:54,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b8a4394b4dc6c0d22f547d578c8c773, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.', STARTKEY => '2', ENDKEY => ''} 2023-09-24 20:01:54,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. service=AccessControlService 2023-09-24 20:01:54,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:54,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c21c20f9d936ffd7e80e3b09d71b4458, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.', STARTKEY => '', ENDKEY => '2'} 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. service=AccessControlService 2023-09-24 20:01:54,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,042 INFO [StoreOpener-4b8a4394b4dc6c0d22f547d578c8c773-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,042 INFO [StoreOpener-c21c20f9d936ffd7e80e3b09d71b4458-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,043 DEBUG [StoreOpener-4b8a4394b4dc6c0d22f547d578c8c773-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf 2023-09-24 20:01:54,043 DEBUG [StoreOpener-4b8a4394b4dc6c0d22f547d578c8c773-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf 2023-09-24 20:01:54,044 INFO [StoreOpener-4b8a4394b4dc6c0d22f547d578c8c773-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b8a4394b4dc6c0d22f547d578c8c773 columnFamilyName cf 2023-09-24 20:01:54,044 DEBUG [StoreOpener-c21c20f9d936ffd7e80e3b09d71b4458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf 2023-09-24 20:01:54,044 DEBUG [StoreOpener-c21c20f9d936ffd7e80e3b09d71b4458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf 2023-09-24 20:01:54,044 INFO [StoreOpener-4b8a4394b4dc6c0d22f547d578c8c773-1] regionserver.HStore(310): Store=4b8a4394b4dc6c0d22f547d578c8c773/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:54,044 INFO [StoreOpener-c21c20f9d936ffd7e80e3b09d71b4458-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c21c20f9d936ffd7e80e3b09d71b4458 columnFamilyName cf 2023-09-24 20:01:54,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,045 INFO [StoreOpener-c21c20f9d936ffd7e80e3b09d71b4458-1] regionserver.HStore(310): Store=c21c20f9d936ffd7e80e3b09d71b4458/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:54,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:54,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:01:54,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b8a4394b4dc6c0d22f547d578c8c773; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60209589, jitterRate=-0.10280720889568329}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:54,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b8a4394b4dc6c0d22f547d578c8c773: 2023-09-24 20:01:54,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c21c20f9d936ffd7e80e3b09d71b4458; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67811142, jitterRate=0.010464757680892944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:54,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c21c20f9d936ffd7e80e3b09d71b4458: 2023-09-24 20:01:54,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773., pid=69, masterSystemTime=1695585714033 2023-09-24 20:01:54,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458., pid=70, masterSystemTime=1695585714034 2023-09-24 20:01:54,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,054 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4b8a4394b4dc6c0d22f547d578c8c773, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:54,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,054 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714054"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585714054"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585714054"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585714054"}]},"ts":"1695585714054"} 2023-09-24 20:01:54,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c21c20f9d936ffd7e80e3b09d71b4458, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:54,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714055"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585714055"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585714055"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585714055"}]},"ts":"1695585714055"} 2023-09-24 20:01:54,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-24 20:01:54,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 4b8a4394b4dc6c0d22f547d578c8c773, server=jenkins-hbase4.apache.org,43375,1695585640237 in 174 msec 2023-09-24 20:01:54,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-24 20:01:54,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure c21c20f9d936ffd7e80e3b09d71b4458, server=jenkins-hbase4.apache.org,46007,1695585640196 in 175 msec 2023-09-24 20:01:54,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, ASSIGN in 335 msec 2023-09-24 20:01:54,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-24 20:01:54,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, ASSIGN in 335 msec 2023-09-24 20:01:54,060 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:01:54,061 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585714061"}]},"ts":"1695585714061"} 2023-09-24 20:01:54,062 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-24 20:01:54,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:01:54,066 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-24 20:01:54,067 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 20:01:54,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:54,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:54,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:54,069 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:01:54,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 20:01:54,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 388 msec 2023-09-24 20:01:54,110 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 20:01:54,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 20:01:54,290 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-24 20:01:54,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773], force=true 2023-09-24 20:01:54,322 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773], force=true 2023-09-24 20:01:54,322 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773], force=true 2023-09-24 20:01:54,323 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773], force=true 2023-09-24 20:01:54,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 20:01:54,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, UNASSIGN}] 2023-09-24 20:01:54,346 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, UNASSIGN 2023-09-24 20:01:54,346 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, UNASSIGN 2023-09-24 20:01:54,347 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c21c20f9d936ffd7e80e3b09d71b4458, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:54,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4b8a4394b4dc6c0d22f547d578c8c773, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:54,347 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585714347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585714347"}]},"ts":"1695585714347"} 2023-09-24 20:01:54,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585714347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585714347"}]},"ts":"1695585714347"} 2023-09-24 20:01:54,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure c21c20f9d936ffd7e80e3b09d71b4458, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:01:54,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4b8a4394b4dc6c0d22f547d578c8c773, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:01:54,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 20:01:54,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c21c20f9d936ffd7e80e3b09d71b4458, disabling compactions & flushes 2023-09-24 20:01:54,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. after waiting 0 ms 2023-09-24 20:01:54,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c21c20f9d936ffd7e80e3b09d71b4458 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 20:01:54,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b8a4394b4dc6c0d22f547d578c8c773, disabling compactions & flushes 2023-09-24 20:01:54,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. after waiting 0 ms 2023-09-24 20:01:54,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4b8a4394b4dc6c0d22f547d578c8c773 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 20:01:54,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/.tmp/cf/28da31670cfb4c1fbf1b055767061a50 2023-09-24 20:01:54,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/.tmp/cf/5b6d0c148ce2449e85de3debf06323e1 2023-09-24 20:01:54,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/.tmp/cf/28da31670cfb4c1fbf1b055767061a50 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50 2023-09-24 20:01:54,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/.tmp/cf/5b6d0c148ce2449e85de3debf06323e1 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1 2023-09-24 20:01:54,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 20:01:54,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 20:01:54,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c21c20f9d936ffd7e80e3b09d71b4458 in 25ms, sequenceid=5, compaction requested=false 2023-09-24 20:01:54,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4b8a4394b4dc6c0d22f547d578c8c773 in 24ms, sequenceid=5, compaction requested=false 2023-09-24 20:01:54,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 20:01:54,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 20:01:54,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:54,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:01:54,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773. 2023-09-24 20:01:54,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458. 2023-09-24 20:01:54,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c21c20f9d936ffd7e80e3b09d71b4458: 2023-09-24 20:01:54,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b8a4394b4dc6c0d22f547d578c8c773: 2023-09-24 20:01:54,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:01:54,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c21c20f9d936ffd7e80e3b09d71b4458, regionState=CLOSED 2023-09-24 20:01:54,544 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585714544"}]},"ts":"1695585714544"} 2023-09-24 20:01:54,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:01:54,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4b8a4394b4dc6c0d22f547d578c8c773, regionState=CLOSED 2023-09-24 20:01:54,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695585714545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585714545"}]},"ts":"1695585714545"} 2023-09-24 20:01:54,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-24 20:01:54,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure c21c20f9d936ffd7e80e3b09d71b4458, server=jenkins-hbase4.apache.org,46007,1695585640196 in 197 msec 2023-09-24 20:01:54,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-24 20:01:54,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4b8a4394b4dc6c0d22f547d578c8c773, server=jenkins-hbase4.apache.org,43375,1695585640237 in 197 msec 2023-09-24 20:01:54,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c21c20f9d936ffd7e80e3b09d71b4458, UNASSIGN in 206 msec 2023-09-24 20:01:54,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-24 20:01:54,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4b8a4394b4dc6c0d22f547d578c8c773, UNASSIGN in 204 msec 2023-09-24 20:01:54,594 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-24 20:01:54,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713681.c21c20f9d936ffd7e80e3b09d71b4458.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:54,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695585713681.4b8a4394b4dc6c0d22f547d578c8c773.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:54,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 20:01:54,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 20:01:54,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, ASSIGN}] 2023-09-24 20:01:54,647 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, ASSIGN 2023-09-24 20:01:54,648 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:01:54,798 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 20:01:54,800 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a5ecc7f486151515be9efd5253efa021, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:54,800 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695585714800"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585714800"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585714800"}]},"ts":"1695585714800"} 2023-09-24 20:01:54,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a5ecc7f486151515be9efd5253efa021, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:01:54,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 20:01:54,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:01:54,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5ecc7f486151515be9efd5253efa021, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.', STARTKEY => '', ENDKEY => ''} 2023-09-24 20:01:54,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. service=AccessControlService 2023-09-24 20:01:54,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:01:54,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:54,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:01:54,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:54,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:54,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/.regioninfo 2023-09-24 20:01:54,969 INFO [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:54,970 DEBUG [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf 2023-09-24 20:01:54,970 DEBUG [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf 2023-09-24 20:01:54,970 INFO [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5ecc7f486151515be9efd5253efa021 columnFamilyName cf 2023-09-24 20:01:54,997 DEBUG [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] regionserver.HStore(539): loaded hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/28da31670cfb4c1fbf1b055767061a50.4b8a4394b4dc6c0d22f547d578c8c773->hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50-top 2023-09-24 20:01:55,003 DEBUG [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] regionserver.HStore(539): loaded hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/5b6d0c148ce2449e85de3debf06323e1.c21c20f9d936ffd7e80e3b09d71b4458->hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1-top 2023-09-24 20:01:55,003 INFO [StoreOpener-a5ecc7f486151515be9efd5253efa021-1] regionserver.HStore(310): Store=a5ecc7f486151515be9efd5253efa021/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:01:55,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:55,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:55,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5ecc7f486151515be9efd5253efa021 2023-09-24 20:01:55,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5ecc7f486151515be9efd5253efa021; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73652836, jitterRate=0.09751278162002563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:01:55,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5ecc7f486151515be9efd5253efa021: 2023-09-24 20:01:55,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021., pid=77, masterSystemTime=1695585714954 2023-09-24 20:01:55,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.,because compaction is disabled. 2023-09-24 20:01:55,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:01:55,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:01:55,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a5ecc7f486151515be9efd5253efa021, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695585715012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585715012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585715012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585715012"}]},"ts":"1695585715012"} 2023-09-24 20:01:55,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-24 20:01:55,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a5ecc7f486151515be9efd5253efa021, server=jenkins-hbase4.apache.org,46007,1695585640196 in 212 msec 2023-09-24 20:01:55,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-24 20:01:55,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, ASSIGN in 369 msec 2023-09-24 20:01:55,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c21c20f9d936ffd7e80e3b09d71b4458, 4b8a4394b4dc6c0d22f547d578c8c773], force=true in 702 msec 2023-09-24 20:01:55,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 20:01:55,430 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-24 20:01:55,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 20:01:55,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585715431 (current time:1695585715431). 2023-09-24 20:01:55,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:01:55,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x69750515 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:55,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64229381, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:55,441 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:55,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69750515 to 127.0.0.1:61864 2023-09-24 20:01:55,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:55,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x3580af98 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:01:55,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@741c4990, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:01:55,450 DEBUG [hconnection-0x4526209-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:01:55,453 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:01:55,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3580af98 to 127.0.0.1:61864 2023-09-24 20:01:55,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:01:55,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 20:01:55,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:01:55,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 20:01:55,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 20:01:55,461 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 20:01:55,462 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695586315462 2023-09-24 20:01:55,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 20:01:55,465 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:01:55,465 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:01:55,466 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 20:01:55,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 20:01:55,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-24 20:01:55,468 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 20:01:55,469 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695586315469 2023-09-24 20:01:55,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,484 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 20:01:55,484 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:55,485 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-24 20:01:55,486 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-24 20:01:55,486 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,486 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,487 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,487 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,487 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,487 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,488 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,488 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 20:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,489 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 20:01:55,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 20:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 20:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 20:01:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 20:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 20:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 20:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 20:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 20:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 20:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 20:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 20:01:55,494 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:55,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:55,495 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:55,497 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:55,498 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,498 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:01:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:55,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-24 20:01:55,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20f33c0c[Count = 0] remaining members to acquire global barrier 2023-09-24 20:01:55,500 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-24 20:01:55,500 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 20:01:55,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,501 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 20:01:55,501 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,502 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:01:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 20:01:55,502 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:01:55,502 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. started... 2023-09-24 20:01:55,504 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5ecc7f486151515be9efd5253efa021: 2023-09-24 20:01:55,504 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,504 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:01:55,504 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/28da31670cfb4c1fbf1b055767061a50.4b8a4394b4dc6c0d22f547d578c8c773->hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50-top, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/5b6d0c148ce2449e85de3debf06323e1.c21c20f9d936ffd7e80e3b09d71b4458->hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1-top] hfiles 2023-09-24 20:01:55,504 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/28da31670cfb4c1fbf1b055767061a50.4b8a4394b4dc6c0d22f547d578c8c773 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,505 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/5b6d0c148ce2449e85de3debf06323e1.c21c20f9d936ffd7e80e3b09d71b4458 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 20:01:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 20:01:55,506 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 20:01:55,507 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:55,507 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 20:01:55,522 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. completed. 2023-09-24 20:01:55,522 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:01:55,522 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:01:55,522 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:01:55,522 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,522 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 20:01:55,522 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:01:55,528 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 20:01:55,528 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,528 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:55,528 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 20:01:55,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:55,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:55,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:01:55,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-24 20:01:55,531 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-24 20:01:55,532 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:01:55,532 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:01:55,532 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,532 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:01:55,533 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,534 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,533 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,534 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:01:55,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,535 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,535 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:01:55,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:01:55,537 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,538 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,538 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,541 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:01:55,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:01:55,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,541 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:01:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:01:55,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,542 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:01:55,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:01:55,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-24 20:01:55,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,564 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695585715462Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695585715542 (+80 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695585715542Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695585715547 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695585715555 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695585715563 (+8 ms) 2023-09-24 20:01:55,566 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:01:55,567 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 20:01:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-24 20:01:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:01:55,568 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568 2023-09-24 20:01:55,568 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32847, tgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568, rawTgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:55,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 102 msec 2023-09-24 20:01:55,591 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:01:55,591 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-754049147_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,591 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-24 20:01:55,599 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:01:55,615 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:55,616 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:55,616 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:55,617 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0004_000001 (auth:SIMPLE) 2023-09-24 20:01:56,495 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-1108416100862642115.jar 2023-09-24 20:01:56,495 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,496 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,563 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-7335638571580655138.jar 2023-09-24 20:01:56,564 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,564 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,565 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,565 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,565 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,566 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:01:56,566 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:01:56,566 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:01:56,567 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:01:56,567 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:01:56,567 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:01:56,568 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:01:56,568 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:01:56,568 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:01:56,569 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:01:56,569 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:01:56,570 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:56,570 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:56,571 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:56,571 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:56,571 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:01:56,572 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:56,572 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:01:56,932 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:01:56,935 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-24 20:01:56,936 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-24 20:01:56,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:56,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:01:57,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0005_000001 (auth:SIMPLE) 2023-09-24 20:01:57,814 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:02:01,146 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0005_000001 (auth:SIMPLE) 2023-09-24 20:02:03,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0005_000001 (auth:SIMPLE) 2023-09-24 20:02:05,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0005_000001 (auth:SIMPLE) 2023-09-24 20:02:07,094 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:02:07,103 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:02:07,111 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,112 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:02:07,112 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:02:07,112 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,113 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 20:02:07,113 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 20:02:07,113 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,114 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 20:02:07,114 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585715568/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 20:02:07,120 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 20:02:07,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585727124"}]},"ts":"1695585727124"} 2023-09-24 20:02:07,125 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-24 20:02:07,127 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-24 20:02:07,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, UNASSIGN}] 2023-09-24 20:02:07,130 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, UNASSIGN 2023-09-24 20:02:07,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a5ecc7f486151515be9efd5253efa021, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:07,131 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695585727130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585727130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585727130"}]},"ts":"1695585727130"} 2023-09-24 20:02:07,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a5ecc7f486151515be9efd5253efa021, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:02:07,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 20:02:07,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5ecc7f486151515be9efd5253efa021 2023-09-24 20:02:07,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5ecc7f486151515be9efd5253efa021, disabling compactions & flushes 2023-09-24 20:02:07,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:02:07,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:02:07,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. after waiting 0 ms 2023-09-24 20:02:07,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:02:07,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-24 20:02:07,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:07,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021. 2023-09-24 20:02:07,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5ecc7f486151515be9efd5253efa021: 2023-09-24 20:02:07,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5ecc7f486151515be9efd5253efa021 2023-09-24 20:02:07,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a5ecc7f486151515be9efd5253efa021, regionState=CLOSED 2023-09-24 20:02:07,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695585727297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585727297"}]},"ts":"1695585727297"} 2023-09-24 20:02:07,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-24 20:02:07,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a5ecc7f486151515be9efd5253efa021, server=jenkins-hbase4.apache.org,46007,1695585640196 in 167 msec 2023-09-24 20:02:07,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-24 20:02:07,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a5ecc7f486151515be9efd5253efa021, UNASSIGN in 172 msec 2023-09-24 20:02:07,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585727302"}]},"ts":"1695585727302"} 2023-09-24 20:02:07,303 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-24 20:02:07,305 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-24 20:02:07,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-24 20:02:07,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 20:02:07,426 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-24 20:02:07,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,431 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,432 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,435 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:02:07,435 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:02:07,435 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021 2023-09-24 20:02:07,436 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,436 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,436 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,436 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 20:02:07,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 20:02:07,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 20:02:07,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 20:02:07,437 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/recovered.edits] 2023-09-24 20:02:07,437 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,437 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,437 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,438 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,438 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,438 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,438 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,438 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,438 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/recovered.edits] 2023-09-24 20:02:07,438 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/recovered.edits] 2023-09-24 20:02:07,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:07,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:07,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:07,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 20:02:07,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:07,443 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/cf/28da31670cfb4c1fbf1b055767061a50 2023-09-24 20:02:07,443 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/cf/5b6d0c148ce2449e85de3debf06323e1 2023-09-24 20:02:07,444 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/28da31670cfb4c1fbf1b055767061a50.4b8a4394b4dc6c0d22f547d578c8c773 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/28da31670cfb4c1fbf1b055767061a50.4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:02:07,445 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/5b6d0c148ce2449e85de3debf06323e1.c21c20f9d936ffd7e80e3b09d71b4458 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/cf/5b6d0c148ce2449e85de3debf06323e1.c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:02:07,446 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/recovered.edits/8.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773/recovered.edits/8.seqid 2023-09-24 20:02:07,446 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/recovered.edits/8.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458/recovered.edits/8.seqid 2023-09-24 20:02:07,447 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4b8a4394b4dc6c0d22f547d578c8c773 2023-09-24 20:02:07,447 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c21c20f9d936ffd7e80e3b09d71b4458 2023-09-24 20:02:07,448 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/recovered.edits/12.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021/recovered.edits/12.seqid 2023-09-24 20:02:07,449 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a5ecc7f486151515be9efd5253efa021 2023-09-24 20:02:07,449 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 20:02:07,451 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,453 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-24 20:02:07,455 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-24 20:02:07,455 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,455 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-24 20:02:07,456 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585727456"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:07,457 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-24 20:02:07,457 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a5ecc7f486151515be9efd5253efa021, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695585713682.a5ecc7f486151515be9efd5253efa021.', STARTKEY => '', ENDKEY => ''}] 2023-09-24 20:02:07,457 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-24 20:02:07,457 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585727457"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:07,459 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-24 20:02:07,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:07,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-24 20:02:07,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 20:02:07,541 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-24 20:02:07,541 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 20:02:07,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585727546"}]},"ts":"1695585727546"} 2023-09-24 20:02:07,547 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-24 20:02:07,549 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-24 20:02:07,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, UNASSIGN}] 2023-09-24 20:02:07,552 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, UNASSIGN 2023-09-24 20:02:07,552 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, UNASSIGN 2023-09-24 20:02:07,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3783ed26213aca60b7d55743ddafcd49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:07,552 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=62a42d99dd145f775826297af9f451c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:07,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585727552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585727552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585727552"}]},"ts":"1695585727552"} 2023-09-24 20:02:07,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585727552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585727552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585727552"}]},"ts":"1695585727552"} 2023-09-24 20:02:07,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 3783ed26213aca60b7d55743ddafcd49, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:02:07,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 62a42d99dd145f775826297af9f451c9, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:02:07,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 20:02:07,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:02:07,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3783ed26213aca60b7d55743ddafcd49, disabling compactions & flushes 2023-09-24 20:02:07,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:02:07,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:02:07,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. after waiting 0 ms 2023-09-24 20:02:07,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:02:07,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 62a42d99dd145f775826297af9f451c9 2023-09-24 20:02:07,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62a42d99dd145f775826297af9f451c9, disabling compactions & flushes 2023-09-24 20:02:07,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:02:07,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:02:07,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. after waiting 0 ms 2023-09-24 20:02:07,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:02:07,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:07,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:07,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:07,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49. 2023-09-24 20:02:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3783ed26213aca60b7d55743ddafcd49: 2023-09-24 20:02:07,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:07,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9. 2023-09-24 20:02:07,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62a42d99dd145f775826297af9f451c9: 2023-09-24 20:02:07,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:02:07,724 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3783ed26213aca60b7d55743ddafcd49, regionState=CLOSED 2023-09-24 20:02:07,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 62a42d99dd145f775826297af9f451c9 2023-09-24 20:02:07,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585727724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585727724"}]},"ts":"1695585727724"} 2023-09-24 20:02:07,725 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=62a42d99dd145f775826297af9f451c9, regionState=CLOSED 2023-09-24 20:02:07,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695585727725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585727725"}]},"ts":"1695585727725"} 2023-09-24 20:02:07,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-24 20:02:07,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 3783ed26213aca60b7d55743ddafcd49, server=jenkins-hbase4.apache.org,37535,1695585640136 in 171 msec 2023-09-24 20:02:07,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-24 20:02:07,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3783ed26213aca60b7d55743ddafcd49, UNASSIGN in 178 msec 2023-09-24 20:02:07,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 62a42d99dd145f775826297af9f451c9, server=jenkins-hbase4.apache.org,43375,1695585640237 in 173 msec 2023-09-24 20:02:07,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-24 20:02:07,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=62a42d99dd145f775826297af9f451c9, UNASSIGN in 179 msec 2023-09-24 20:02:07,731 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585727730"}]},"ts":"1695585727730"} 2023-09-24 20:02:07,732 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-24 20:02:07,734 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-24 20:02:07,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 193 msec 2023-09-24 20:02:07,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 20:02:07,848 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-24 20:02:07,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,852 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,853 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,854 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,856 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,856 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,856 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,856 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 20:02:07,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 20:02:07,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 20:02:07,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 20:02:07,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:02:07,857 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,858 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:07,859 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/recovered.edits] 2023-09-24 20:02:07,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 20:02:07,859 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/recovered.edits] 2023-09-24 20:02:07,863 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/cf/1182ad9f786241d299fa0851c42dad55 2023-09-24 20:02:07,863 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/cf/e67c9cf8a5624eb8a8d35c695e60b8cd 2023-09-24 20:02:07,866 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49/recovered.edits/9.seqid 2023-09-24 20:02:07,866 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9/recovered.edits/9.seqid 2023-09-24 20:02:07,867 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3783ed26213aca60b7d55743ddafcd49 2023-09-24 20:02:07,867 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/62a42d99dd145f775826297af9f451c9 2023-09-24 20:02:07,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 20:02:07,867 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 20:02:07,868 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-24 20:02:07,871 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924dc253bc4e994403490060802349dfc24 2023-09-24 20:02:07,872 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924ae3aea5f361d4d2c8a3372efea05161e 2023-09-24 20:02:07,872 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 20:02:07,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,876 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-24 20:02:07,878 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-24 20:02:07,878 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,878 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-24 20:02:07,879 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585727878"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:07,879 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585727878"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:07,880 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:02:07,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3783ed26213aca60b7d55743ddafcd49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695585712517.3783ed26213aca60b7d55743ddafcd49.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 62a42d99dd145f775826297af9f451c9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695585712517.62a42d99dd145f775826297af9f451c9.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:02:07,880 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-24 20:02:07,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585727880"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:07,881 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-24 20:02:07,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-24 20:02:07,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 20:02:07,961 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-24 20:02:07,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 20:02:07,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 20:02:07,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 20:02:07,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-24 20:02:07,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 20:02:08,000 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 746) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:51614 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:51226 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2025385339_1 at /127.0.0.1:51582 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4076 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:42762 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2025385339_1 at /127.0.0.1:51192 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:37311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=908 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 184), ProcessCount=168 (was 168), AvailableMemoryMB=7510 (was 7598) 2023-09-24 20:02:08,001 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-24 20:02:08,019 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=168, AvailableMemoryMB=7510 2023-09-24 20:02:08,020 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-24 20:02:08,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:02:08,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:08,024 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:02:08,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-24 20:02:08,025 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:02:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 20:02:08,027 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,027 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,028 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 empty. 2023-09-24 20:02:08,028 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa empty. 2023-09-24 20:02:08,028 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,028 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,028 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 20:02:08,037 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 20:02:08,038 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 070882d24b5c5781c79b98009ba5e3e5, NAME => 'testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:02:08,038 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e3d3f6ae6cef4f40854214a79aa2efa, NAME => 'testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 070882d24b5c5781c79b98009ba5e3e5, disabling compactions & flushes 2023-09-24 20:02:08,045 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. after waiting 0 ms 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,045 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 070882d24b5c5781c79b98009ba5e3e5: 2023-09-24 20:02:08,045 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:08,046 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1e3d3f6ae6cef4f40854214a79aa2efa, disabling compactions & flushes 2023-09-24 20:02:08,046 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,046 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,046 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. after waiting 0 ms 2023-09-24 20:02:08,046 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,046 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,046 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1e3d3f6ae6cef4f40854214a79aa2efa: 2023-09-24 20:02:08,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:02:08,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585728048"}]},"ts":"1695585728048"} 2023-09-24 20:02:08,049 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585728048"}]},"ts":"1695585728048"} 2023-09-24 20:02:08,050 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:02:08,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:02:08,051 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585728051"}]},"ts":"1695585728051"} 2023-09-24 20:02:08,052 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 20:02:08,055 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:02:08,056 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:02:08,056 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:02:08,056 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:02:08,056 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:02:08,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, ASSIGN}] 2023-09-24 20:02:08,058 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, ASSIGN 2023-09-24 20:02:08,058 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, ASSIGN 2023-09-24 20:02:08,059 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37535,1695585640136; forceNewPlan=false, retain=false 2023-09-24 20:02:08,059 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:02:08,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 20:02:08,209 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:02:08,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=070882d24b5c5781c79b98009ba5e3e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,212 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1e3d3f6ae6cef4f40854214a79aa2efa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585728212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585728212"}]},"ts":"1695585728212"} 2023-09-24 20:02:08,212 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585728212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585728212"}]},"ts":"1695585728212"} 2023-09-24 20:02:08,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 070882d24b5c5781c79b98009ba5e3e5, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:02:08,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 1e3d3f6ae6cef4f40854214a79aa2efa, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:02:08,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 20:02:08,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 070882d24b5c5781c79b98009ba5e3e5, NAME => 'testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:02:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e3d3f6ae6cef4f40854214a79aa2efa, NAME => 'testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:02:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. service=AccessControlService 2023-09-24 20:02:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. service=AccessControlService 2023-09-24 20:02:08,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,371 INFO [StoreOpener-070882d24b5c5781c79b98009ba5e3e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,371 INFO [StoreOpener-1e3d3f6ae6cef4f40854214a79aa2efa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,372 DEBUG [StoreOpener-070882d24b5c5781c79b98009ba5e3e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf 2023-09-24 20:02:08,372 DEBUG [StoreOpener-1e3d3f6ae6cef4f40854214a79aa2efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf 2023-09-24 20:02:08,372 DEBUG [StoreOpener-070882d24b5c5781c79b98009ba5e3e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf 2023-09-24 20:02:08,372 DEBUG [StoreOpener-1e3d3f6ae6cef4f40854214a79aa2efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf 2023-09-24 20:02:08,373 INFO [StoreOpener-1e3d3f6ae6cef4f40854214a79aa2efa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e3d3f6ae6cef4f40854214a79aa2efa columnFamilyName cf 2023-09-24 20:02:08,373 INFO [StoreOpener-070882d24b5c5781c79b98009ba5e3e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070882d24b5c5781c79b98009ba5e3e5 columnFamilyName cf 2023-09-24 20:02:08,374 INFO [StoreOpener-1e3d3f6ae6cef4f40854214a79aa2efa-1] regionserver.HStore(310): Store=1e3d3f6ae6cef4f40854214a79aa2efa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:02:08,374 INFO [StoreOpener-070882d24b5c5781c79b98009ba5e3e5-1] regionserver.HStore(310): Store=070882d24b5c5781c79b98009ba5e3e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:02:08,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:08,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:08,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:02:08,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:02:08,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e3d3f6ae6cef4f40854214a79aa2efa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71368575, jitterRate=0.063474640250206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:02:08,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 070882d24b5c5781c79b98009ba5e3e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74609380, jitterRate=0.11176639795303345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:02:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e3d3f6ae6cef4f40854214a79aa2efa: 2023-09-24 20:02:08,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 070882d24b5c5781c79b98009ba5e3e5: 2023-09-24 20:02:08,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5., pid=93, masterSystemTime=1695585728365 2023-09-24 20:02:08,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa., pid=94, masterSystemTime=1695585728367 2023-09-24 20:02:08,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,383 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=070882d24b5c5781c79b98009ba5e3e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,383 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585728383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585728383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585728383"}]},"ts":"1695585728383"} 2023-09-24 20:02:08,384 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1e3d3f6ae6cef4f40854214a79aa2efa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,384 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585728384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585728384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585728384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585728384"}]},"ts":"1695585728384"} 2023-09-24 20:02:08,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-24 20:02:08,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 070882d24b5c5781c79b98009ba5e3e5, server=jenkins-hbase4.apache.org,46007,1695585640196 in 171 msec 2023-09-24 20:02:08,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-24 20:02:08,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 1e3d3f6ae6cef4f40854214a79aa2efa, server=jenkins-hbase4.apache.org,37535,1695585640136 in 171 msec 2023-09-24 20:02:08,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, ASSIGN in 331 msec 2023-09-24 20:02:08,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-24 20:02:08,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, ASSIGN in 332 msec 2023-09-24 20:02:08,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:02:08,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585728390"}]},"ts":"1695585728390"} 2023-09-24 20:02:08,391 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 20:02:08,393 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:02:08,393 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-24 20:02:08,395 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:02:08,397 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:08,397 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:08,397 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:08,397 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:08,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:08,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:08,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:08,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:08,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 377 msec 2023-09-24 20:02:08,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 20:02:08,628 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-24 20:02:08,630 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:08,631 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,633 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:02:08,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:08,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585728645 (current time:1695585728645). 2023-09-24 20:02:08,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:02:08,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x29cb241c to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:08,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2220d73d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:08,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:08,659 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29cb241c to 127.0.0.1:61864 2023-09-24 20:02:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:08,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbe3dd5 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:08,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6da511ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:08,670 DEBUG [hconnection-0x4918aa0c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:08,671 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:08,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbe3dd5 to 127.0.0.1:61864 2023-09-24 20:02:08,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:08,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:02:08,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:02:08,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:08,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:08,679 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:08,680 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695586328680 2023-09-24 20:02:08,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:08,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:08,681 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:02:08,682 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:08,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:08,682 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:02:08,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-24 20:02:08,686 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:08,687 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695586328687 2023-09-24 20:02:08,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,696 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-24 20:02:08,696 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:08,697 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 20:02:08,698 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 20:02:08,698 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,698 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,704 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,704 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,704 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,704 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,705 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,706 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:08,706 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:08,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:08,706 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:08,710 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:08,710 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:08,710 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:08,711 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,711 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:08,711 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,712 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,712 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:08,712 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:08,712 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:08,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:08,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@198e8690[Count = 1] remaining members to acquire global barrier 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:08,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:08,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 20:02:08,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@198e8690[Count = 0] remaining members to acquire global barrier 2023-09-24 20:02:08,717 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 20:02:08,718 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:08,720 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,720 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,720 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:08,720 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:08,720 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:02:08,721 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,721 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:02:08,722 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:08,722 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:08,722 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:08,726 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:08,726 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:08,726 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:08,726 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,726 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:08,726 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. started... 2023-09-24 20:02:08,726 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,726 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. started... 2023-09-24 20:02:08,727 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 070882d24b5c5781c79b98009ba5e3e5: 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e3d3f6ae6cef4f40854214a79aa2efa: 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:02:08,728 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:02:08,740 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. completed. 2023-09-24 20:02:08,740 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:08,740 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:02:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:08,742 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. completed. 2023-09-24 20:02:08,742 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:08,742 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:08,744 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:08,744 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,743 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,744 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:08,744 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:02:08,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:08,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:08,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:08,745 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:08,745 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:08,745 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:08,745 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:08,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:02:08,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 20:02:08,751 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 20:02:08,752 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:02:08,752 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:02:08,752 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,752 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:02:08,754 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:08,755 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,755 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:08,755 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,756 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:08,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,757 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:08,758 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,758 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,760 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:08,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:08,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:02:08,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,761 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:08,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:08,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,761 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:08,764 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:08,764 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,765 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:08,765 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:08,765 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,765 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:02:08,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:08,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,783 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:08,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:02:08,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:02:08,784 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:02:08,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 20:02:08,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,787 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:08,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695585728680Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695585728771 (+91 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695585728771Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695585728771Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695585728775 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695585728781 (+6 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695585728787 (+6 ms) 2023-09-24 20:02:08,790 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:08,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 109 msec 2023-09-24 20:02:08,984 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:08,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:02:08,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:02:08,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:02:08,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37535] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:02:08,991 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:08,991 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:08,991 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:02:08,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:08,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585728999 (current time:1695585728999). 2023-09-24 20:02:08,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:02:09,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x28eee087 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24aa775c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:09,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:09,010 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28eee087 to 127.0.0.1:61864 2023-09-24 20:02:09,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x2eb702af to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:09,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71822526, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:09,019 DEBUG [hconnection-0x665acdd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:09,022 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:09,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eb702af to 127.0.0.1:61864 2023-09-24 20:02:09,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:09,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 20:02:09,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:02:09,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:09,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:09,030 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:09,031 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695586329031 2023-09-24 20:02:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 20:02:09,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:09,032 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:02:09,032 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:02:09,035 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 20:02:09,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:09,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-24 20:02:09,037 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:09,037 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695586329037 2023-09-24 20:02:09,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,048 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-24 20:02:09,048 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:09,049 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 20:02:09,049 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 20:02:09,049 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,049 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,050 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,051 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,051 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,051 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,051 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,051 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,052 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 20:02:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:09,053 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 20:02:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 20:02:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 20:02:09,059 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,059 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:09,059 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,059 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:09,060 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,061 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1579ef88[Count = 1] remaining members to acquire global barrier 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:09,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 20:02:09,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1579ef88[Count = 0] remaining members to acquire global barrier 2023-09-24 20:02:09,064 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 20:02:09,064 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:09,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,067 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:09,068 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:09,068 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,068 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:09,068 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:09,068 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. started... 2023-09-24 20:02:09,068 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:09,068 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. started... 2023-09-24 20:02:09,068 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e3d3f6ae6cef4f40854214a79aa2efa 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-09-24 20:02:09,068 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 070882d24b5c5781c79b98009ba5e3e5 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-09-24 20:02:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:09,085 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb 2023-09-24 20:02:09,086 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02 2023-09-24 20:02:09,093 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/.tmp/cf/887099d5e2f84955be61cde38971ef49 2023-09-24 20:02:09,095 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/.tmp/cf/0e77e84ef0be457da74d08aa737be5e8 2023-09-24 20:02:09,099 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/.tmp/cf/887099d5e2f84955be61cde38971ef49 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49 2023-09-24 20:02:09,101 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/.tmp/cf/0e77e84ef0be457da74d08aa737be5e8 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8 2023-09-24 20:02:09,104 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49, entries=7, sequenceid=6, filesize=6.1 K 2023-09-24 20:02:09,105 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 070882d24b5c5781c79b98009ba5e3e5 in 37ms, sequenceid=6, compaction requested=false 2023-09-24 20:02:09,105 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-24 20:02:09,105 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8, entries=43, sequenceid=6, filesize=12.4 K 2023-09-24 20:02:09,105 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 070882d24b5c5781c79b98009ba5e3e5: 2023-09-24 20:02:09,106 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,106 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:09,106 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49] hfiles 2023-09-24 20:02:09,106 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,106 INFO [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 1e3d3f6ae6cef4f40854214a79aa2efa in 38ms, sequenceid=6, compaction requested=false 2023-09-24 20:02:09,108 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e3d3f6ae6cef4f40854214a79aa2efa: 2023-09-24 20:02:09,108 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,109 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:09,109 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8] hfiles 2023-09-24 20:02:09,109 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,116 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. completed. 2023-09-24 20:02:09,116 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:02:09,117 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. completed. 2023-09-24 20:02:09,117 DEBUG [rs(jenkins-hbase4.apache.org,37535,1695585640136)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 20:02:09,117 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:02:09,118 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:09,121 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,121 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 20:02:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:09,121 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:09,121 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 20:02:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37535,1695585640136': 2023-09-24 20:02:09,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 20:02:09,128 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 20:02:09,128 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:02:09,128 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:02:09,128 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,128 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,130 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:09,131 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,132 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,132 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,132 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:02:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:02:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,133 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:02:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,134 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:09,134 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,135 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,137 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,139 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:09,137 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:09,139 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:09,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:09,139 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,139 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:09,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,139 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:02:09,140 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:09,140 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:09,140 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,140 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb] mob files 2023-09-24 20:02:09,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02 2023-09-24 20:02:09,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb 2023-09-24 20:02:09,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 20:02:09,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,172 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695585729031Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695585729151 (+120 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695585729151Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695585729151Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695585729155 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695585729165 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695585729171 (+6 ms) 2023-09-24 20:02:09,174 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 20:02:09,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 143 msec 2023-09-24 20:02:09,333 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 20:02:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:02:09,335 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335 2023-09-24 20:02:09,335 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32847, tgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335, rawTgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:02:09,357 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:02:09,357 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1051604710_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,357 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-24 20:02:09,363 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:09,381 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:09,382 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:09,382 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:09,383 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,256 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-8865517569819741973.jar 2023-09-24 20:02:10,256 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,257 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,323 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-3883951260294105729.jar 2023-09-24 20:02:10,324 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,324 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,324 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,325 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,325 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,325 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:10,326 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:02:10,326 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:02:10,326 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:02:10,327 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:02:10,327 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:02:10,328 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:02:10,328 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:02:10,328 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:02:10,328 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:02:10,329 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:02:10,330 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:10,330 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:10,330 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:10,331 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:10,331 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:10,331 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:10,332 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:10,677 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:02:10,679 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-24 20:02:11,902 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:02:11,902 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:02:11,904 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0005_000001 (auth:SIMPLE) 2023-09-24 20:02:12,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0006_000001 (auth:SIMPLE) 2023-09-24 20:02:12,902 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:02:16,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0006_000001 (auth:SIMPLE) 2023-09-24 20:02:19,031 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:02:19,032 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:02:19,037 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:19,037 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:02:19,037 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:02:19,037 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 20:02:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 20:02:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 20:02:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585729335/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 20:02:19,042 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 20:02:19,046 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585739046"}]},"ts":"1695585739046"} 2023-09-24 20:02:19,048 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 20:02:19,049 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-24 20:02:19,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, UNASSIGN}] 2023-09-24 20:02:19,051 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, UNASSIGN 2023-09-24 20:02:19,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, UNASSIGN 2023-09-24 20:02:19,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=070882d24b5c5781c79b98009ba5e3e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:19,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1e3d3f6ae6cef4f40854214a79aa2efa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:19,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585739052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585739052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585739052"}]},"ts":"1695585739052"} 2023-09-24 20:02:19,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585739052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585739052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585739052"}]},"ts":"1695585739052"} 2023-09-24 20:02:19,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 070882d24b5c5781c79b98009ba5e3e5, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:02:19,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 1e3d3f6ae6cef4f40854214a79aa2efa, server=jenkins-hbase4.apache.org,37535,1695585640136}] 2023-09-24 20:02:19,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 20:02:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:19,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 070882d24b5c5781c79b98009ba5e3e5, disabling compactions & flushes 2023-09-24 20:02:19,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e3d3f6ae6cef4f40854214a79aa2efa, disabling compactions & flushes 2023-09-24 20:02:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. after waiting 0 ms 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. after waiting 0 ms 2023-09-24 20:02:19,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:19,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:19,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:19,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:19,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:19,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5. 2023-09-24 20:02:19,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 070882d24b5c5781c79b98009ba5e3e5: 2023-09-24 20:02:19,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa. 2023-09-24 20:02:19,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e3d3f6ae6cef4f40854214a79aa2efa: 2023-09-24 20:02:19,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:19,218 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=070882d24b5c5781c79b98009ba5e3e5, regionState=CLOSED 2023-09-24 20:02:19,219 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585739218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585739218"}]},"ts":"1695585739218"} 2023-09-24 20:02:19,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:19,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1e3d3f6ae6cef4f40854214a79aa2efa, regionState=CLOSED 2023-09-24 20:02:19,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695585739219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585739219"}]},"ts":"1695585739219"} 2023-09-24 20:02:19,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-24 20:02:19,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 070882d24b5c5781c79b98009ba5e3e5, server=jenkins-hbase4.apache.org,46007,1695585640196 in 167 msec 2023-09-24 20:02:19,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-24 20:02:19,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 1e3d3f6ae6cef4f40854214a79aa2efa, server=jenkins-hbase4.apache.org,37535,1695585640136 in 167 msec 2023-09-24 20:02:19,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070882d24b5c5781c79b98009ba5e3e5, UNASSIGN in 173 msec 2023-09-24 20:02:19,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-24 20:02:19,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e3d3f6ae6cef4f40854214a79aa2efa, UNASSIGN in 172 msec 2023-09-24 20:02:19,224 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585739224"}]},"ts":"1695585739224"} 2023-09-24 20:02:19,225 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 20:02:19,226 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-24 20:02:19,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-09-24 20:02:19,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 20:02:19,348 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-24 20:02:19,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,353 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,354 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,356 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:19,356 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:19,358 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/recovered.edits] 2023-09-24 20:02:19,358 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/recovered.edits] 2023-09-24 20:02:19,361 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,361 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,361 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,362 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,362 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/cf/887099d5e2f84955be61cde38971ef49 2023-09-24 20:02:19,362 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/cf/0e77e84ef0be457da74d08aa737be5e8 2023-09-24 20:02:19,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 20:02:19,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 20:02:19,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 20:02:19,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,363 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 20:02:19,365 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,365 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,365 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5/recovered.edits/9.seqid 2023-09-24 20:02:19,365 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa/recovered.edits/9.seqid 2023-09-24 20:02:19,366 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e3d3f6ae6cef4f40854214a79aa2efa 2023-09-24 20:02:19,366 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testEmptyExportFileSystemState/070882d24b5c5781c79b98009ba5e3e5 2023-09-24 20:02:19,366 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 20:02:19,366 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 20:02:19,367 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-24 20:02:19,370 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230924253495a393894ea1ae7f7441f31a6b02 2023-09-24 20:02:19,371 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092421fdabcb04bf469088778ad0bedb72eb 2023-09-24 20:02:19,371 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 20:02:19,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,375 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-24 20:02:19,377 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-24 20:02:19,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-24 20:02:19,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585739378"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:19,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585739378"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:19,380 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:02:19,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 070882d24b5c5781c79b98009ba5e3e5, NAME => 'testtb-testEmptyExportFileSystemState,,1695585728021.070882d24b5c5781c79b98009ba5e3e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e3d3f6ae6cef4f40854214a79aa2efa, NAME => 'testtb-testEmptyExportFileSystemState,1,1695585728021.1e3d3f6ae6cef4f40854214a79aa2efa.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:02:19,380 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-24 20:02:19,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585739380"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:19,382 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-24 20:02:19,383 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 20:02:19,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-24 20:02:19,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 20:02:19,466 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-24 20:02:19,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-24 20:02:19,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:19,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-24 20:02:19,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-24 20:02:19,501 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:36938 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1796109755_1 at /127.0.0.1:40686 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:39777 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35405 from appattempt_1695585646774_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1796109755_1 at /127.0.0.1:45022 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:45032 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1073921793_17 at /127.0.0.1:40700 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4730 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x289a8375-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:40201 from appattempt_1695585646774_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x289a8375-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 170), ProcessCount=168 (was 168), AvailableMemoryMB=7491 (was 7510) 2023-09-24 20:02:19,501 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-24 20:02:19,523 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=168, AvailableMemoryMB=7528 2023-09-24 20:02:19,523 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-24 20:02:19,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 20:02:19,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:19,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 20:02:19,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-24 20:02:19,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 20:02:19,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 20:02:19,531 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,531 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,531 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 empty. 2023-09-24 20:02:19,531 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed empty. 2023-09-24 20:02:19,532 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,532 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 20:02:19,541 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-24 20:02:19,542 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef3f0f5d33d0378e2f1a8bc991aafb67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:02:19,542 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 965ba8cbd7865b80de50e254347d97ed, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 965ba8cbd7865b80de50e254347d97ed, disabling compactions & flushes 2023-09-24 20:02:19,553 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. after waiting 0 ms 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,553 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,553 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 965ba8cbd7865b80de50e254347d97ed: 2023-09-24 20:02:19,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:19,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ef3f0f5d33d0378e2f1a8bc991aafb67, disabling compactions & flushes 2023-09-24 20:02:19,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. after waiting 0 ms 2023-09-24 20:02:19,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ef3f0f5d33d0378e2f1a8bc991aafb67: 2023-09-24 20:02:19,557 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 20:02:19,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585739558"}]},"ts":"1695585739558"} 2023-09-24 20:02:19,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585739558"}]},"ts":"1695585739558"} 2023-09-24 20:02:19,560 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 20:02:19,561 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 20:02:19,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585739561"}]},"ts":"1695585739561"} 2023-09-24 20:02:19,562 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-24 20:02:19,567 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 20:02:19,568 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 20:02:19,568 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 20:02:19,568 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 20:02:19,568 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 20:02:19,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, ASSIGN}] 2023-09-24 20:02:19,571 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, ASSIGN 2023-09-24 20:02:19,571 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, ASSIGN 2023-09-24 20:02:19,571 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1695585640196; forceNewPlan=false, retain=false 2023-09-24 20:02:19,571 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43375,1695585640237; forceNewPlan=false, retain=false 2023-09-24 20:02:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 20:02:19,721 INFO [jenkins-hbase4:40043] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 20:02:19,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=965ba8cbd7865b80de50e254347d97ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:19,724 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef3f0f5d33d0378e2f1a8bc991aafb67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:19,724 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585739724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585739724"}]},"ts":"1695585739724"} 2023-09-24 20:02:19,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585739724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585739724"}]},"ts":"1695585739724"} 2023-09-24 20:02:19,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 965ba8cbd7865b80de50e254347d97ed, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:02:19,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ef3f0f5d33d0378e2f1a8bc991aafb67, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:02:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 20:02:19,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 965ba8cbd7865b80de50e254347d97ed, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 20:02:19,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef3f0f5d33d0378e2f1a8bc991aafb67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. service=AccessControlService 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. service=AccessControlService 2023-09-24 20:02:19,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:02:19,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:19,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 20:02:19,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,883 INFO [StoreOpener-ef3f0f5d33d0378e2f1a8bc991aafb67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,883 INFO [StoreOpener-965ba8cbd7865b80de50e254347d97ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,884 DEBUG [StoreOpener-ef3f0f5d33d0378e2f1a8bc991aafb67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf 2023-09-24 20:02:19,884 DEBUG [StoreOpener-965ba8cbd7865b80de50e254347d97ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf 2023-09-24 20:02:19,884 DEBUG [StoreOpener-ef3f0f5d33d0378e2f1a8bc991aafb67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf 2023-09-24 20:02:19,884 DEBUG [StoreOpener-965ba8cbd7865b80de50e254347d97ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf 2023-09-24 20:02:19,885 INFO [StoreOpener-ef3f0f5d33d0378e2f1a8bc991aafb67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef3f0f5d33d0378e2f1a8bc991aafb67 columnFamilyName cf 2023-09-24 20:02:19,885 INFO [StoreOpener-965ba8cbd7865b80de50e254347d97ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 965ba8cbd7865b80de50e254347d97ed columnFamilyName cf 2023-09-24 20:02:19,886 INFO [StoreOpener-ef3f0f5d33d0378e2f1a8bc991aafb67-1] regionserver.HStore(310): Store=ef3f0f5d33d0378e2f1a8bc991aafb67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:02:19,886 INFO [StoreOpener-965ba8cbd7865b80de50e254347d97ed-1] regionserver.HStore(310): Store=965ba8cbd7865b80de50e254347d97ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 20:02:19,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:19,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:19,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:02:19,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 20:02:19,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 965ba8cbd7865b80de50e254347d97ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63094867, jitterRate=-0.05981321632862091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:02:19,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef3f0f5d33d0378e2f1a8bc991aafb67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69513753, jitterRate=0.035835638642311096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 20:02:19,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 965ba8cbd7865b80de50e254347d97ed: 2023-09-24 20:02:19,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef3f0f5d33d0378e2f1a8bc991aafb67: 2023-09-24 20:02:19,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67., pid=109, masterSystemTime=1695585739878 2023-09-24 20:02:19,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed., pid=108, masterSystemTime=1695585739877 2023-09-24 20:02:19,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:19,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef3f0f5d33d0378e2f1a8bc991aafb67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:19,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:19,896 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585739895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585739895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585739895"}]},"ts":"1695585739895"} 2023-09-24 20:02:19,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=965ba8cbd7865b80de50e254347d97ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:19,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585739896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695585739896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695585739896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695585739896"}]},"ts":"1695585739896"} 2023-09-24 20:02:19,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-24 20:02:19,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ef3f0f5d33d0378e2f1a8bc991aafb67, server=jenkins-hbase4.apache.org,46007,1695585640196 in 170 msec 2023-09-24 20:02:19,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-24 20:02:19,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 965ba8cbd7865b80de50e254347d97ed, server=jenkins-hbase4.apache.org,43375,1695585640237 in 172 msec 2023-09-24 20:02:19,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, ASSIGN in 330 msec 2023-09-24 20:02:19,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-24 20:02:19,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, ASSIGN in 331 msec 2023-09-24 20:02:19,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 20:02:19,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585739902"}]},"ts":"1695585739902"} 2023-09-24 20:02:19,903 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-24 20:02:19,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 20:02:19,906 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-24 20:02:19,907 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 20:02:19,909 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,909 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,909 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,909 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:19,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:19,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:19,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-09-24 20:02:19,913 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:19,913 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 20:02:20,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 20:02:20,132 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-24 20:02:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,136 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:02:20,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585740146 (current time:1695585740146). 2023-09-24 20:02:20,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:02:20,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x565978a2 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:20,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63c0e3f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:20,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:20,159 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x565978a2 to 127.0.0.1:61864 2023-09-24 20:02:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:20,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x5862b90d to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:20,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@456356cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:20,167 DEBUG [hconnection-0x21d8dacb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:20,169 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5862b90d to 127.0.0.1:61864 2023-09-24 20:02:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 20:02:20,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:02:20,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,177 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,178 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695586340178 2023-09-24 20:02:20,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,179 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:02:20,179 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:02:20,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,182 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-24 20:02:20,183 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,184 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695586340184 2023-09-24 20:02:20,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,193 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 20:02:20,193 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,194 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 20:02:20,194 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 20:02:20,194 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,195 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,196 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,196 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,196 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,196 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,197 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,197 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,201 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,201 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,207 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,208 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,208 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,209 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a654a72[Count = 1] remaining members to acquire global barrier 2023-09-24 20:02:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 20:02:20,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a654a72[Count = 0] remaining members to acquire global barrier 2023-09-24 20:02:20,212 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 20:02:20,212 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,213 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,213 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,213 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:02:20,214 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,214 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,214 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,214 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:20,218 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:20,218 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,218 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. started... 2023-09-24 20:02:20,218 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. started... 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 965ba8cbd7865b80de50e254347d97ed: 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef3f0f5d33d0378e2f1a8bc991aafb67: 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:02:20,219 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 20:02:20,228 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. completed. 2023-09-24 20:02:20,228 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,228 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. completed. 2023-09-24 20:02:20,228 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,231 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,234 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:02:20,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 20:02:20,240 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 20:02:20,240 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:02:20,240 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:02:20,240 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,240 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,243 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,243 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,244 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,245 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,246 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,246 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,248 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,248 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,248 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,249 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,249 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,250 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 20:02:20,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 20:02:20,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,276 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695585740178Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695585740258 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695585740258Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695585740258Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695585740261 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695585740270 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695585740276 (+6 ms) 2023-09-24 20:02:20,278 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,279 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:20,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 99 msec 2023-09-24 20:02:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 20:02:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:02:20,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:02:20,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43375] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 20:02:20,285 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,285 DEBUG [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,286 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 20:02:20,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695585740295 (current time:1695585740295). 2023-09-24 20:02:20,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 20:02:20,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x6284ee76 to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:20,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56d7e6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:20,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:20,306 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:20,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6284ee76 to 127.0.0.1:61864 2023-09-24 20:02:20,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:20,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(139): Connect 0x73524d1e to 127.0.0.1:61864 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 20:02:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3660fa5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 20:02:20,314 DEBUG [hconnection-0x589064f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 20:02:20,315 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 20:02:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73524d1e to 127.0.0.1:61864 2023-09-24 20:02:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:02:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 20:02:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 20:02:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,324 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695586340325 2023-09-24 20:02:20,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 20:02:20,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 20:02:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 20:02:20,327 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 20:02:20,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-24 20:02:20,329 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,330 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695586340330 2023-09-24 20:02:20,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,338 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 20:02:20,338 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,339 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 20:02:20,339 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 20:02:20,340 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,340 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,341 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,341 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,341 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,341 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,341 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,341 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,342 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,342 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,343 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,343 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,344 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,344 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 20:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,344 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 20:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37535,1695585640136' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 20:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 20:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 20:02:20,349 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,349 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 20:02:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1695585640196' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43cf1a6e[Count = 1] remaining members to acquire global barrier 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43375,1695585640237' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 20:02:20,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43cf1a6e[Count = 0] remaining members to acquire global barrier 2023-09-24 20:02:20,353 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 20:02:20,353 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,356 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,356 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,356 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 20:02:20,357 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:20,356 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 20:02:20,357 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. started... 2023-09-24 20:02:20,357 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,357 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37535,1695585640136' in zk 2023-09-24 20:02:20,357 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:20,357 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 20:02:20,357 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 965ba8cbd7865b80de50e254347d97ed 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-24 20:02:20,356 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. started... 2023-09-24 20:02:20,356 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 20:02:20,357 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ef3f0f5d33d0378e2f1a8bc991aafb67 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-24 20:02:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,37535,1695585640136' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,377 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae 2023-09-24 20:02:20,378 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009 2023-09-24 20:02:20,387 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/.tmp/cf/239aab8d40ea4661b50508b28eec162c 2023-09-24 20:02:20,388 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/.tmp/cf/17746fd6bae947638892091b5a86f945 2023-09-24 20:02:20,392 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/.tmp/cf/17746fd6bae947638892091b5a86f945 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945 2023-09-24 20:02:20,392 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/.tmp/cf/239aab8d40ea4661b50508b28eec162c as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c 2023-09-24 20:02:20,396 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945, entries=47, sequenceid=6, filesize=13.3 K 2023-09-24 20:02:20,396 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-24 20:02:20,397 INFO [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ef3f0f5d33d0378e2f1a8bc991aafb67 in 40ms, sequenceid=6, compaction requested=false 2023-09-24 20:02:20,397 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-24 20:02:20,397 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef3f0f5d33d0378e2f1a8bc991aafb67: 2023-09-24 20:02:20,398 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,398 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:20,398 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c] hfiles 2023-09-24 20:02:20,398 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,400 INFO [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 965ba8cbd7865b80de50e254347d97ed in 43ms, sequenceid=6, compaction requested=false 2023-09-24 20:02:20,402 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 965ba8cbd7865b80de50e254347d97ed: 2023-09-24 20:02:20,402 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,402 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 20:02:20,402 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945] hfiles 2023-09-24 20:02:20,402 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,406 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. completed. 2023-09-24 20:02:20,406 DEBUG [rs(jenkins-hbase4.apache.org,46007,1695585640196)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:20,406 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:20,406 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:20,406 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,406 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,406 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46007,1695585640196' in zk 2023-09-24 20:02:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,408 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1695585640196' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,410 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. completed. 2023-09-24 20:02:20,410 DEBUG [rs(jenkins-hbase4.apache.org,43375,1695585640237)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 20:02:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 20:02:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 20:02:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43375,1695585640237' in zk 2023-09-24 20:02:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,412 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,412 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 20:02:20,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,412 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,412 DEBUG [member: 'jenkins-hbase4.apache.org,43375,1695585640237' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 20:02:20,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46007,1695585640196': 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1695585640196' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43375,1695585640237': 2023-09-24 20:02:20,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43375,1695585640237' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 20:02:20,418 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 20:02:20,418 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 20:02:20,418 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 20:02:20,418 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,418 INFO [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 20:02:20,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,420 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,419 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,421 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 20:02:20,422 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,423 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,423 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,426 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:20,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 20:02:20,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 20:02:20,427 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,430 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 20:02:20,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,431 DEBUG [(jenkins-hbase4.apache.org,40043,1695585638864)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 20:02:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 20:02:20,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 20:02:20,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 20:02:20,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 20:02:20,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 20:02:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,433 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae] mob files 2023-09-24 20:02:20,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009 2023-09-24 20:02:20,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae 2023-09-24 20:02:20,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 20:02:20,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,458 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695585740325Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695585740440 (+115 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695585740440Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695585740440Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695585740445 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695585740451 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695585740457 (+6 ms) 2023-09-24 20:02:20,461 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 20:02:20,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 135 msec 2023-09-24 20:02:20,627 DEBUG [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 20:02:20,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 20:02:20,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 20:02:20,629 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629 2023-09-24 20:02:20,629 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32847, tgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629, rawTgtDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629, srcFsUri=hdfs://localhost:32847, srcDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:02:20,651 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395 2023-09-24 20:02:20,651 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1669743582_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,651 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32847, inputRoot=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395, snapshotDir=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-24 20:02:20,659 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:20,680 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:20,681 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:20,681 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:20,681 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,552 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-4521597536066926947.jar 2023-09-24 20:02:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,553 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,619 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/hadoop-5298326747688334040.jar 2023-09-24 20:02:21,620 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,620 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 20:02:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 20:02:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 20:02:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 20:02:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 20:02:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 20:02:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 20:02:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 20:02:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 20:02:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 20:02:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 20:02:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 20:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/39171] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 20:02:21,984 WARN [Listener at jenkins-hbase4.apache.org/39171] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 20:02:21,987 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-24 20:02:21,989 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-24 20:02:23,323 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:02:23,323 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 20:02:23,330 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0006_000001 (auth:SIMPLE) 2023-09-24 20:02:23,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0007_000001 (auth:SIMPLE) 2023-09-24 20:02:24,822 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:02:27,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0007_000001 (auth:SIMPLE) 2023-09-24 20:02:29,903 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0007_000001 (auth:SIMPLE) 2023-09-24 20:02:32,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695585646774_0007_000001 (auth:SIMPLE) 2023-09-24 20:02:34,142 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 20:02:34,143 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 20:02:34,153 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,153 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 20:02:34,153 INFO [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 20:02:34,154 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,154 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 20:02:34,154 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 20:02:34,154 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1073921793_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,154 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 20:02:34,155 DEBUG [Listener at jenkins-hbase4.apache.org/39171] snapshot.TestExportSnapshot(367): hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/export-test/export-1695585740629/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 20:02:34,161 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 20:02:34,166 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585754166"}]},"ts":"1695585754166"} 2023-09-24 20:02:34,167 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-24 20:02:34,169 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-24 20:02:34,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, UNASSIGN}] 2023-09-24 20:02:34,172 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, UNASSIGN 2023-09-24 20:02:34,172 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, UNASSIGN 2023-09-24 20:02:34,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef3f0f5d33d0378e2f1a8bc991aafb67, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:02:34,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=965ba8cbd7865b80de50e254347d97ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:02:34,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585754172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585754172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585754172"}]},"ts":"1695585754172"} 2023-09-24 20:02:34,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585754172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695585754172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695585754172"}]},"ts":"1695585754172"} 2023-09-24 20:02:34,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ef3f0f5d33d0378e2f1a8bc991aafb67, server=jenkins-hbase4.apache.org,46007,1695585640196}] 2023-09-24 20:02:34,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 965ba8cbd7865b80de50e254347d97ed, server=jenkins-hbase4.apache.org,43375,1695585640237}] 2023-09-24 20:02:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 20:02:34,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:34,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef3f0f5d33d0378e2f1a8bc991aafb67, disabling compactions & flushes 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 965ba8cbd7865b80de50e254347d97ed, disabling compactions & flushes 2023-09-24 20:02:34,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:34,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. after waiting 0 ms 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. after waiting 0 ms 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:34,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:02:34,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:34,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:02:34,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed. 2023-09-24 20:02:34,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 965ba8cbd7865b80de50e254347d97ed: 2023-09-24 20:02:34,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67. 2023-09-24 20:02:34,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef3f0f5d33d0378e2f1a8bc991aafb67: 2023-09-24 20:02:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:34,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=965ba8cbd7865b80de50e254347d97ed, regionState=CLOSED 2023-09-24 20:02:34,341 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585754341"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585754341"}]},"ts":"1695585754341"} 2023-09-24 20:02:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:34,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef3f0f5d33d0378e2f1a8bc991aafb67, regionState=CLOSED 2023-09-24 20:02:34,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695585754342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695585754342"}]},"ts":"1695585754342"} 2023-09-24 20:02:34,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-24 20:02:34,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 965ba8cbd7865b80de50e254347d97ed, server=jenkins-hbase4.apache.org,43375,1695585640237 in 168 msec 2023-09-24 20:02:34,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-24 20:02:34,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ef3f0f5d33d0378e2f1a8bc991aafb67, server=jenkins-hbase4.apache.org,46007,1695585640196 in 169 msec 2023-09-24 20:02:34,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=965ba8cbd7865b80de50e254347d97ed, UNASSIGN in 174 msec 2023-09-24 20:02:34,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-24 20:02:34,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef3f0f5d33d0378e2f1a8bc991aafb67, UNASSIGN in 175 msec 2023-09-24 20:02:34,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695585754346"}]},"ts":"1695585754346"} 2023-09-24 20:02:34,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-24 20:02:34,349 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-24 20:02:34,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-24 20:02:34,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 20:02:34,467 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-24 20:02:34,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,470 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,471 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,472 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46007] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:34,474 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:34,475 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,475 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,475 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,476 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 20:02:34,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 20:02:34,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 20:02:34,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 20:02:34,476 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/recovered.edits] 2023-09-24 20:02:34,477 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf, FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/recovered.edits] 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:34,477 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 20:02:34,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 20:02:34,480 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/cf/239aab8d40ea4661b50508b28eec162c 2023-09-24 20:02:34,480 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/cf/17746fd6bae947638892091b5a86f945 2023-09-24 20:02:34,483 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67/recovered.edits/9.seqid 2023-09-24 20:02:34,483 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/recovered.edits/9.seqid to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed/recovered.edits/9.seqid 2023-09-24 20:02:34,484 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef3f0f5d33d0378e2f1a8bc991aafb67 2023-09-24 20:02:34,484 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/965ba8cbd7865b80de50e254347d97ed 2023-09-24 20:02:34,484 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 20:02:34,484 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 20:02:34,485 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-24 20:02:34,488 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009 to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230924205d28b1f12f47a1b2224da8cf851009 2023-09-24 20:02:34,489 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae to hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924353a289100434877805e2751339651ae 2023-09-24 20:02:34,489 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 20:02:34,491 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,493 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-24 20:02:34,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-24 20:02:34,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-24 20:02:34,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585754496"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:34,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695585754496"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:34,497 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 20:02:34,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef3f0f5d33d0378e2f1a8bc991aafb67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695585739524.ef3f0f5d33d0378e2f1a8bc991aafb67.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 965ba8cbd7865b80de50e254347d97ed, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695585739524.965ba8cbd7865b80de50e254347d97ed.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 20:02:34,497 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-24 20:02:34,498 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695585754497"}]},"ts":"9223372036854775807"} 2023-09-24 20:02:34,499 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-24 20:02:34,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-24 20:02:34,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 20:02:34,579 INFO [Listener at jenkins-hbase4.apache.org/39171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-24 20:02:34,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 20:02:34,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 20:02:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40043] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 20:02:34,613 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=906 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 152), ProcessCount=168 (was 168), AvailableMemoryMB=7418 (was 7528) 2023-09-24 20:02:34,614 WARN [Listener at jenkins-hbase4.apache.org/39171] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-24 20:02:34,614 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-24 20:02:34,624 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 20:02:34,735 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695585646774_0007_01_000001 is : 143 2023-09-24 20:02:39,907 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 20:02:48,751 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 20:03:02,869 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 20:03:02,870 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 20:03:02,982 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-24 20:03:02,991 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-24 20:03:02,992 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 20:03:03,001 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 20:03:03,105 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 20:03:03,105 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-24 20:03:03,105 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-24 20:03:03,105 INFO [Listener at jenkins-hbase4.apache.org/39171] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-24 20:03:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/39171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a20d86f to 127.0.0.1:61864 2023-09-24 20:03:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,105 DEBUG [Listener at jenkins-hbase4.apache.org/39171] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-24 20:03:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/39171] util.JVMClusterUtil(257): Found active master hash=1597975956, stopped=false 2023-09-24 20:03:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/39171] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,106 DEBUG [Listener at jenkins-hbase4.apache.org/39171] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 20:03:03,106 INFO [Listener at jenkins-hbase4.apache.org/39171] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:03:03,108 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 20:03:03,108 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 20:03:03,108 INFO [Listener at jenkins-hbase4.apache.org/39171] procedure2.ProcedureExecutor(628): Stopping 2023-09-24 20:03:03,108 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 20:03:03,108 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 20:03:03,108 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:03:03,108 DEBUG [Listener at jenkins-hbase4.apache.org/39171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x401a1cb9 to 127.0.0.1:61864 2023-09-24 20:03:03,109 DEBUG [Listener at jenkins-hbase4.apache.org/39171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,109 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37535,1695585640136' ***** 2023-09-24 20:03:03,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:03:03,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:03:03,109 DEBUG [Listener at jenkins-hbase4.apache.org/39171] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:03:03,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 20:03:03,109 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 20:03:03,109 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46007,1695585640196' ***** 2023-09-24 20:03:03,109 DEBUG [Listener at jenkins-hbase4.apache.org/39171] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,110 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 20:03:03,110 INFO [RS:0;jenkins-hbase4:37535] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 20:03:03,110 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43375,1695585640237' ***** 2023-09-24 20:03:03,110 DEBUG [Listener at jenkins-hbase4.apache.org/39171] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,110 INFO [RS:0;jenkins-hbase4:37535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 20:03:03,110 INFO [Listener at jenkins-hbase4.apache.org/39171] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 20:03:03,110 INFO [RS:0;jenkins-hbase4:37535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 20:03:03,110 INFO [RS:1;jenkins-hbase4:46007] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 20:03:03,110 INFO [RS:2;jenkins-hbase4:43375] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 20:03:03,110 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 20:03:03,110 INFO [RS:2;jenkins-hbase4:43375] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 20:03:03,110 INFO [RS:1;jenkins-hbase4:46007] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 20:03:03,110 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:03:03,110 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 20:03:03,110 DEBUG [RS:0;jenkins-hbase4:37535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbcce64 to 127.0.0.1:61864 2023-09-24 20:03:03,110 INFO [RS:1;jenkins-hbase4:46007] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 20:03:03,110 INFO [RS:2;jenkins-hbase4:43375] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 20:03:03,110 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 20:03:03,110 DEBUG [RS:0;jenkins-hbase4:37535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,111 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(3305): Received CLOSE for a2c5586146040b58bb9b129322a42cda 2023-09-24 20:03:03,112 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37535,1695585640136; all regions closed. 2023-09-24 20:03:03,111 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(3305): Received CLOSE for 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:03:03,112 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:03:03,112 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:03:03,112 DEBUG [RS:2;jenkins-hbase4:43375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ea5fd02 to 127.0.0.1:61864 2023-09-24 20:03:03,112 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e8c7836 to 127.0.0.1:61864 2023-09-24 20:03:03,112 DEBUG [RS:2;jenkins-hbase4:43375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,113 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 31a7979cf71aa81458ff552f2329f0bf, disabling compactions & flushes 2023-09-24 20:03:03,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2c5586146040b58bb9b129322a42cda, disabling compactions & flushes 2023-09-24 20:03:03,115 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 20:03:03,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:03:03,115 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-24 20:03:03,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:03:03,116 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1478): Online Regions={31a7979cf71aa81458ff552f2329f0bf=hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf.} 2023-09-24 20:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:03:03,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:03:03,115 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 20:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. after waiting 0 ms 2023-09-24 20:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. after waiting 0 ms 2023-09-24 20:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:03:03,116 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 20:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:03:03,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a2c5586146040b58bb9b129322a42cda 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-24 20:03:03,116 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-24 20:03:03,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 31a7979cf71aa81458ff552f2329f0bf 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-24 20:03:03,116 DEBUG [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1504): Waiting on 31a7979cf71aa81458ff552f2329f0bf 2023-09-24 20:03:03,116 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-24 20:03:03,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 20:03:03,117 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1478): Online Regions={a2c5586146040b58bb9b129322a42cda=hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda., 1588230740=hbase:meta,,1.1588230740} 2023-09-24 20:03:03,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 20:03:03,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 20:03:03,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 20:03:03,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 20:03:03,117 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1504): Waiting on 1588230740, a2c5586146040b58bb9b129322a42cda 2023-09-24 20:03:03,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-24 20:03:03,131 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,131 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,131 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,133 DEBUG [RS:0;jenkins-hbase4:37535] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs 2023-09-24 20:03:03,133 INFO [RS:0;jenkins-hbase4:37535] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37535%2C1695585640136:(num 1695585641904) 2023-09-24 20:03:03,133 DEBUG [RS:0;jenkins-hbase4:37535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,133 INFO [RS:0;jenkins-hbase4:37535] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,133 INFO [RS:0;jenkins-hbase4:37535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-24 20:03:03,134 INFO [RS:0;jenkins-hbase4:37535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 20:03:03,134 INFO [RS:0;jenkins-hbase4:37535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 20:03:03,134 INFO [RS:0;jenkins-hbase4:37535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 20:03:03,134 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 20:03:03,135 INFO [RS:0;jenkins-hbase4:37535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37535 2023-09-24 20:03:03,154 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:03:03,155 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,155 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:03:03,155 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,154 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37535,1695585640136 2023-09-24 20:03:03,155 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,155 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/.tmp/l/418807cd14df4e8d8a37193341a709ec 2023-09-24 20:03:03,158 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37535,1695585640136] 2023-09-24 20:03:03,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/.tmp/info/ebe3ce66a24c47bd8e4f164cc5b4b747 2023-09-24 20:03:03,170 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37535,1695585640136; numProcessing=1 2023-09-24 20:03:03,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/info/7d88afe6eec44a26b4e1ad180af6ba39 2023-09-24 20:03:03,172 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37535,1695585640136 already deleted, retry=false 2023-09-24 20:03:03,172 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37535,1695585640136 expired; onlineServers=2 2023-09-24 20:03:03,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 418807cd14df4e8d8a37193341a709ec 2023-09-24 20:03:03,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/.tmp/l/418807cd14df4e8d8a37193341a709ec as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/l/418807cd14df4e8d8a37193341a709ec 2023-09-24 20:03:03,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d88afe6eec44a26b4e1ad180af6ba39 2023-09-24 20:03:03,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/.tmp/info/ebe3ce66a24c47bd8e4f164cc5b4b747 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/info/ebe3ce66a24c47bd8e4f164cc5b4b747 2023-09-24 20:03:03,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 418807cd14df4e8d8a37193341a709ec 2023-09-24 20:03:03,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/l/418807cd14df4e8d8a37193341a709ec, entries=7, sequenceid=18, filesize=5.2 K 2023-09-24 20:03:03,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/info/ebe3ce66a24c47bd8e4f164cc5b4b747, entries=2, sequenceid=6, filesize=4.8 K 2023-09-24 20:03:03,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a2c5586146040b58bb9b129322a42cda in 71ms, sequenceid=18, compaction requested=false 2023-09-24 20:03:03,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 31a7979cf71aa81458ff552f2329f0bf in 72ms, sequenceid=6, compaction requested=false 2023-09-24 20:03:03,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/rep_barrier/18ca945d75244cd1a966c9f9c715ec98 2023-09-24 20:03:03,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/namespace/31a7979cf71aa81458ff552f2329f0bf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 20:03:03,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:03:03,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 31a7979cf71aa81458ff552f2329f0bf: 2023-09-24 20:03:03,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695585642368.31a7979cf71aa81458ff552f2329f0bf. 2023-09-24 20:03:03,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/acl/a2c5586146040b58bb9b129322a42cda/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-24 20:03:03,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:03:03,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2c5586146040b58bb9b129322a42cda: 2023-09-24 20:03:03,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695585643113.a2c5586146040b58bb9b129322a42cda. 2023-09-24 20:03:03,207 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18ca945d75244cd1a966c9f9c715ec98 2023-09-24 20:03:03,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/table/a5f16f7ce3c34bf78c59bf8c6ca5adec 2023-09-24 20:03:03,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5f16f7ce3c34bf78c59bf8c6ca5adec 2023-09-24 20:03:03,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/info/7d88afe6eec44a26b4e1ad180af6ba39 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/info/7d88afe6eec44a26b4e1ad180af6ba39 2023-09-24 20:03:03,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d88afe6eec44a26b4e1ad180af6ba39 2023-09-24 20:03:03,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/info/7d88afe6eec44a26b4e1ad180af6ba39, entries=48, sequenceid=131, filesize=10.3 K 2023-09-24 20:03:03,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/rep_barrier/18ca945d75244cd1a966c9f9c715ec98 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/rep_barrier/18ca945d75244cd1a966c9f9c715ec98 2023-09-24 20:03:03,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18ca945d75244cd1a966c9f9c715ec98 2023-09-24 20:03:03,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/rep_barrier/18ca945d75244cd1a966c9f9c715ec98, entries=13, sequenceid=131, filesize=6.4 K 2023-09-24 20:03:03,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/.tmp/table/a5f16f7ce3c34bf78c59bf8c6ca5adec as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/table/a5f16f7ce3c34bf78c59bf8c6ca5adec 2023-09-24 20:03:03,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5f16f7ce3c34bf78c59bf8c6ca5adec 2023-09-24 20:03:03,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/table/a5f16f7ce3c34bf78c59bf8c6ca5adec, entries=24, sequenceid=131, filesize=6.9 K 2023-09-24 20:03:03,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 118ms, sequenceid=131, compaction requested=false 2023-09-24 20:03:03,244 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-24 20:03:03,244 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 20:03:03,245 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 20:03:03,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 20:03:03,245 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 20:03:03,245 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-24 20:03:03,259 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,259 INFO [RS:0;jenkins-hbase4:37535] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37535,1695585640136; zookeeper connection closed. 2023-09-24 20:03:03,259 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:37535-0x100df86cd910001, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,259 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4323a684] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4323a684 2023-09-24 20:03:03,316 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43375,1695585640237; all regions closed. 2023-09-24 20:03:03,318 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46007,1695585640196; all regions closed. 2023-09-24 20:03:03,324 DEBUG [RS:2;jenkins-hbase4:43375] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs 2023-09-24 20:03:03,324 INFO [RS:2;jenkins-hbase4:43375] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43375%2C1695585640237:(num 1695585641904) 2023-09-24 20:03:03,324 DEBUG [RS:2;jenkins-hbase4:43375] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,324 INFO [RS:2;jenkins-hbase4:43375] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,324 INFO [RS:2;jenkins-hbase4:43375] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 20:03:03,325 INFO [RS:2;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 20:03:03,325 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 20:03:03,325 INFO [RS:2;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 20:03:03,325 INFO [RS:2;jenkins-hbase4:43375] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 20:03:03,325 DEBUG [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs 2023-09-24 20:03:03,325 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46007%2C1695585640196.meta:.meta(num 1695585642064) 2023-09-24 20:03:03,326 INFO [RS:2;jenkins-hbase4:43375] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43375 2023-09-24 20:03:03,329 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,329 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:03:03,329 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43375,1695585640237 2023-09-24 20:03:03,330 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43375,1695585640237] 2023-09-24 20:03:03,330 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43375,1695585640237; numProcessing=2 2023-09-24 20:03:03,332 DEBUG [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/oldWALs 2023-09-24 20:03:03,332 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43375,1695585640237 already deleted, retry=false 2023-09-24 20:03:03,332 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46007%2C1695585640196:(num 1695585641904) 2023-09-24 20:03:03,332 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43375,1695585640237 expired; onlineServers=1 2023-09-24 20:03:03,332 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,332 INFO [RS:1;jenkins-hbase4:46007] regionserver.LeaseManager(133): Closed leases 2023-09-24 20:03:03,332 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 20:03:03,332 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 20:03:03,333 INFO [RS:1;jenkins-hbase4:46007] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46007 2023-09-24 20:03:03,334 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 20:03:03,334 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46007,1695585640196 2023-09-24 20:03:03,335 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46007,1695585640196] 2023-09-24 20:03:03,335 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46007,1695585640196; numProcessing=3 2023-09-24 20:03:03,337 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46007,1695585640196 already deleted, retry=false 2023-09-24 20:03:03,337 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46007,1695585640196 expired; onlineServers=0 2023-09-24 20:03:03,337 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40043,1695585638864' ***** 2023-09-24 20:03:03,337 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-24 20:03:03,337 DEBUG [M:0;jenkins-hbase4:40043] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e0227af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 20:03:03,337 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40043,1695585638864 2023-09-24 20:03:03,337 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40043,1695585638864; all regions closed. 2023-09-24 20:03:03,337 DEBUG [M:0;jenkins-hbase4:40043] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 20:03:03,337 DEBUG [M:0;jenkins-hbase4:40043] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-24 20:03:03,338 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-24 20:03:03,338 DEBUG [M:0;jenkins-hbase4:40043] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-24 20:03:03,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695585641531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695585641531,5,FailOnTimeoutGroup] 2023-09-24 20:03:03,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695585641530] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695585641530,5,FailOnTimeoutGroup] 2023-09-24 20:03:03,338 INFO [M:0;jenkins-hbase4:40043] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-24 20:03:03,338 INFO [M:0;jenkins-hbase4:40043] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-24 20:03:03,338 INFO [M:0;jenkins-hbase4:40043] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-24 20:03:03,338 DEBUG [M:0;jenkins-hbase4:40043] master.HMaster(1512): Stopping service threads 2023-09-24 20:03:03,338 INFO [M:0;jenkins-hbase4:40043] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-24 20:03:03,338 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-24 20:03:03,338 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 20:03:03,338 ERROR [M:0;jenkins-hbase4:40043] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-24 20:03:03,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 20:03:03,339 INFO [M:0;jenkins-hbase4:40043] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-24 20:03:03,339 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-24 20:03:03,339 DEBUG [M:0;jenkins-hbase4:40043] zookeeper.ZKUtil(398): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-24 20:03:03,340 WARN [M:0;jenkins-hbase4:40043] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-24 20:03:03,340 INFO [M:0;jenkins-hbase4:40043] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-24 20:03:03,340 INFO [M:0;jenkins-hbase4:40043] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-24 20:03:03,340 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 20:03:03,340 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:03:03,340 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:03:03,340 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 20:03:03,340 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:03:03,340 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.15 KB 2023-09-24 20:03:03,355 INFO [M:0;jenkins-hbase4:40043] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe4e80c45cda466e8fd5d58df4ae5845 2023-09-24 20:03:03,358 INFO [M:0;jenkins-hbase4:40043] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe4e80c45cda466e8fd5d58df4ae5845 2023-09-24 20:03:03,359 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe4e80c45cda466e8fd5d58df4ae5845 as hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe4e80c45cda466e8fd5d58df4ae5845 2023-09-24 20:03:03,363 INFO [M:0;jenkins-hbase4:40043] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe4e80c45cda466e8fd5d58df4ae5845 2023-09-24 20:03:03,363 INFO [M:0;jenkins-hbase4:40043] regionserver.HStore(1080): Added hdfs://localhost:32847/user/jenkins/test-data/8b59cf8b-aba8-7bc1-eb86-ff9c135da395/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe4e80c45cda466e8fd5d58df4ae5845, entries=119, sequenceid=899, filesize=28.7 K 2023-09-24 20:03:03,364 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384928, heapSize ~452.13 KB/462984, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-24 20:03:03,365 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 20:03:03,365 DEBUG [M:0;jenkins-hbase4:40043] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 20:03:03,368 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 20:03:03,368 INFO [M:0;jenkins-hbase4:40043] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-24 20:03:03,368 INFO [M:0;jenkins-hbase4:40043] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40043 2023-09-24 20:03:03,370 DEBUG [M:0;jenkins-hbase4:40043] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40043,1695585638864 already deleted, retry=false 2023-09-24 20:03:03,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,431 INFO [RS:2;jenkins-hbase4:43375] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43375,1695585640237; zookeeper connection closed. 2023-09-24 20:03:03,431 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:43375-0x100df86cd910003, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,431 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46f0f73e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46f0f73e 2023-09-24 20:03:03,531 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,531 INFO [M:0;jenkins-hbase4:40043] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40043,1695585638864; zookeeper connection closed. 2023-09-24 20:03:03,531 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): master:40043-0x100df86cd910000, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,631 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,631 DEBUG [Listener at localhost/45415-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x100df86cd910002, quorum=127.0.0.1:61864, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 20:03:03,631 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46007,1695585640196; zookeeper connection closed. 2023-09-24 20:03:03,632 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5cbe22e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5cbe22e0 2023-09-24 20:03:03,632 INFO [Listener at jenkins-hbase4.apache.org/39171] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-24 20:03:03,632 WARN [Listener at jenkins-hbase4.apache.org/39171] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 20:03:03,636 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 20:03:03,740 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 20:03:03,740 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-168367538-172.31.14.131-1695585635003 (Datanode Uuid e348408b-80e7-41be-b97e-b943648a5ad8) service to localhost/127.0.0.1:32847 2023-09-24 20:03:03,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data5/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data6/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,743 WARN [Listener at jenkins-hbase4.apache.org/39171] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 20:03:03,745 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 20:03:03,849 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 20:03:03,849 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-168367538-172.31.14.131-1695585635003 (Datanode Uuid beb225ef-6a1c-4708-90ba-41c43fc96ac8) service to localhost/127.0.0.1:32847 2023-09-24 20:03:03,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data3/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data4/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,851 WARN [Listener at jenkins-hbase4.apache.org/39171] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 20:03:03,857 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 20:03:03,960 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 20:03:03,960 WARN [BP-168367538-172.31.14.131-1695585635003 heartbeating to localhost/127.0.0.1:32847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-168367538-172.31.14.131-1695585635003 (Datanode Uuid a50f88cb-e068-41a0-995f-2842fe84f1a0) service to localhost/127.0.0.1:32847 2023-09-24 20:03:03,961 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data1/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,961 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d04973de-a499-12b9-f8ea-c3ee32467564/cluster_e110a873-87a7-7fd5-aaba-54e9ead1fa76/dfs/data/data2/current/BP-168367538-172.31.14.131-1695585635003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 20:03:03,982 INFO [Listener at jenkins-hbase4.apache.org/39171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 20:03:04,107 INFO [Listener at jenkins-hbase4.apache.org/39171] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-24 20:03:04,199 INFO [Listener at jenkins-hbase4.apache.org/39171] hbase.HBaseTestingUtility(1293): Minicluster is down