2023-07-18 04:10:15,965 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 04:10:16,245 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6 2023-07-18 04:10:16,246 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-18 04:10:16,290 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 04:10:16,563 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 04:10:16,564 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30, deleteOnExit=true 2023-07-18 04:10:16,564 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 04:10:16,565 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/test.cache.data in system properties and HBase conf 2023-07-18 04:10:16,566 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 04:10:16,566 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop.log.dir in system properties and HBase conf 2023-07-18 04:10:16,567 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 04:10:16,567 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 04:10:16,567 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 04:10:16,921 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 04:10:16,925 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:16,925 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:16,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 04:10:16,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:16,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 04:10:16,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 04:10:16,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:16,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:16,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 04:10:16,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/nfs.dump.dir in system properties and HBase conf 2023-07-18 04:10:16,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir in system properties and HBase conf 2023-07-18 04:10:16,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:16,930 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 04:10:16,930 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 04:10:17,532 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 04:10:17,537 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 04:10:17,821 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 04:10:18,004 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 04:10:18,016 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:18,053 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:18,086 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_localhost_40329_hdfs____z0xvfs/webapp 2023-07-18 04:10:18,230 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40329 2023-07-18 04:10:18,276 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 04:10:18,277 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 04:10:18,781 WARN [Listener at localhost/45769] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:18,864 WARN [Listener at localhost/45769] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:18,884 WARN [Listener at localhost/45769] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:18,890 INFO [Listener at localhost/45769] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:18,897 INFO [Listener at localhost/45769] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_localhost_35731_datanode____m3mdne/webapp 2023-07-18 04:10:19,012 INFO [Listener at localhost/45769] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35731 2023-07-18 04:10:19,577 WARN [Listener at localhost/33455] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:19,615 WARN [Listener at localhost/33455] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:19,619 WARN [Listener at localhost/33455] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:19,620 INFO [Listener at localhost/33455] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:19,625 INFO [Listener at localhost/33455] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_localhost_34289_datanode____.wofv53/webapp 2023-07-18 04:10:19,756 INFO [Listener at localhost/33455] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34289 2023-07-18 04:10:19,782 WARN [Listener at localhost/34029] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:19,838 WARN [Listener at localhost/34029] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:19,847 WARN [Listener at localhost/34029] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:19,849 INFO [Listener at localhost/34029] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:19,860 INFO [Listener at localhost/34029] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_localhost_41933_datanode____.nnaonx/webapp 2023-07-18 04:10:20,059 INFO [Listener at localhost/34029] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41933 2023-07-18 04:10:20,102 WARN [Listener at localhost/42327] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:20,379 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3661eb1ea95aa736: Processing first storage report for DS-79235424-fc67-4e02-8e41-eec1d95b0d90 from datanode a536d59f-d7a6-445e-a26c-c3b6292eb336 2023-07-18 04:10:20,381 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3661eb1ea95aa736: from storage DS-79235424-fc67-4e02-8e41-eec1d95b0d90 node DatanodeRegistration(127.0.0.1:35077, datanodeUuid=a536d59f-d7a6-445e-a26c-c3b6292eb336, infoPort=38529, infoSecurePort=0, ipcPort=42327, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,381 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e0294b73a209cf3: Processing first storage report for DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4 from datanode 17e3e051-1b2c-4bfb-955b-03c80aee0cdd 2023-07-18 04:10:20,381 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e0294b73a209cf3: from storage DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4 node DatanodeRegistration(127.0.0.1:33903, datanodeUuid=17e3e051-1b2c-4bfb-955b-03c80aee0cdd, infoPort=44361, infoSecurePort=0, ipcPort=33455, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,381 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3661eb1ea95aa736: Processing first storage report for DS-82c0296c-c5e9-43e7-8486-ffb3ff875c29 from datanode a536d59f-d7a6-445e-a26c-c3b6292eb336 2023-07-18 04:10:20,382 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3661eb1ea95aa736: from storage DS-82c0296c-c5e9-43e7-8486-ffb3ff875c29 node DatanodeRegistration(127.0.0.1:35077, datanodeUuid=a536d59f-d7a6-445e-a26c-c3b6292eb336, infoPort=38529, infoSecurePort=0, ipcPort=42327, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,382 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5e0294b73a209cf3: Processing first storage report for DS-f8cac73f-58ba-4e3c-92ea-5030bd357c4d from datanode 17e3e051-1b2c-4bfb-955b-03c80aee0cdd 2023-07-18 04:10:20,382 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5e0294b73a209cf3: from storage DS-f8cac73f-58ba-4e3c-92ea-5030bd357c4d node DatanodeRegistration(127.0.0.1:33903, datanodeUuid=17e3e051-1b2c-4bfb-955b-03c80aee0cdd, infoPort=44361, infoSecurePort=0, ipcPort=33455, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81e8e30d102e79aa: Processing first storage report for DS-079525c5-3c70-487a-a83d-610becf62247 from datanode 2d0747ef-6fd3-42f6-9da7-1346eab321dd 2023-07-18 04:10:20,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81e8e30d102e79aa: from storage DS-079525c5-3c70-487a-a83d-610becf62247 node DatanodeRegistration(127.0.0.1:46755, datanodeUuid=2d0747ef-6fd3-42f6-9da7-1346eab321dd, infoPort=44243, infoSecurePort=0, ipcPort=34029, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81e8e30d102e79aa: Processing first storage report for DS-379a43e1-e596-4ebd-a3c0-71f9ed6c2537 from datanode 2d0747ef-6fd3-42f6-9da7-1346eab321dd 2023-07-18 04:10:20,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81e8e30d102e79aa: from storage DS-379a43e1-e596-4ebd-a3c0-71f9ed6c2537 node DatanodeRegistration(127.0.0.1:46755, datanodeUuid=2d0747ef-6fd3-42f6-9da7-1346eab321dd, infoPort=44243, infoSecurePort=0, ipcPort=34029, storageInfo=lv=-57;cid=testClusterID;nsid=1143876853;c=1689653417605), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,618 DEBUG [Listener at localhost/42327] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6 2023-07-18 04:10:20,697 INFO [Listener at localhost/42327] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/zookeeper_0, clientPort=52746, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 04:10:20,725 INFO [Listener at localhost/42327] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52746 2023-07-18 04:10:20,737 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:20,740 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:21,420 INFO [Listener at localhost/42327] util.FSUtils(471): Created version file at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 with version=8 2023-07-18 04:10:21,421 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/hbase-staging 2023-07-18 04:10:21,786 INFO [Listener at localhost/42327] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 04:10:22,461 INFO [Listener at localhost/42327] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:22,502 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,503 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,503 INFO [Listener at localhost/42327] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:22,503 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,503 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:22,686 INFO [Listener at localhost/42327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:22,787 DEBUG [Listener at localhost/42327] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 04:10:22,897 INFO [Listener at localhost/42327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39993 2023-07-18 04:10:22,916 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:22,919 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:22,946 INFO [Listener at localhost/42327] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39993 connecting to ZooKeeper ensemble=127.0.0.1:52746 2023-07-18 04:10:23,004 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:399930x0, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39993-0x101769fa5880000 connected 2023-07-18 04:10:23,049 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,050 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,066 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,078 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39993 2023-07-18 04:10:23,079 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39993 2023-07-18 04:10:23,079 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39993 2023-07-18 04:10:23,082 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39993 2023-07-18 04:10:23,086 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39993 2023-07-18 04:10:23,095 INFO [Listener at localhost/42327] master.HMaster(444): hbase.rootdir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, hbase.cluster.distributed=false 2023-07-18 04:10:23,185 INFO [Listener at localhost/42327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,185 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,185 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,186 INFO [Listener at localhost/42327] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,186 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,186 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,193 INFO [Listener at localhost/42327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,199 INFO [Listener at localhost/42327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40467 2023-07-18 04:10:23,202 INFO [Listener at localhost/42327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,214 DEBUG [Listener at localhost/42327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 04:10:23,216 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,218 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,220 INFO [Listener at localhost/42327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40467 connecting to ZooKeeper ensemble=127.0.0.1:52746 2023-07-18 04:10:23,229 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:404670x0, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,230 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:404670x0, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40467-0x101769fa5880001 connected 2023-07-18 04:10:23,233 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,234 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,238 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40467 2023-07-18 04:10:23,242 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40467 2023-07-18 04:10:23,247 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40467 2023-07-18 04:10:23,248 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40467 2023-07-18 04:10:23,248 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40467 2023-07-18 04:10:23,262 INFO [Listener at localhost/42327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,263 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,263 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,264 INFO [Listener at localhost/42327] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,264 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,264 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,264 INFO [Listener at localhost/42327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,268 INFO [Listener at localhost/42327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34797 2023-07-18 04:10:23,269 INFO [Listener at localhost/42327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,272 DEBUG [Listener at localhost/42327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 04:10:23,273 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,276 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,278 INFO [Listener at localhost/42327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34797 connecting to ZooKeeper ensemble=127.0.0.1:52746 2023-07-18 04:10:23,291 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:347970x0, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34797-0x101769fa5880002 connected 2023-07-18 04:10:23,294 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,296 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,303 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,311 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34797 2023-07-18 04:10:23,311 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34797 2023-07-18 04:10:23,314 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34797 2023-07-18 04:10:23,315 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34797 2023-07-18 04:10:23,318 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34797 2023-07-18 04:10:23,337 INFO [Listener at localhost/42327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,337 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,338 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,338 INFO [Listener at localhost/42327] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,338 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,338 INFO [Listener at localhost/42327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,338 INFO [Listener at localhost/42327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,340 INFO [Listener at localhost/42327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36369 2023-07-18 04:10:23,341 INFO [Listener at localhost/42327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,349 DEBUG [Listener at localhost/42327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 04:10:23,350 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,353 INFO [Listener at localhost/42327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,364 INFO [Listener at localhost/42327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36369 connecting to ZooKeeper ensemble=127.0.0.1:52746 2023-07-18 04:10:23,371 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:363690x0, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36369-0x101769fa5880003 connected 2023-07-18 04:10:23,376 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,376 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,377 DEBUG [Listener at localhost/42327] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,380 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36369 2023-07-18 04:10:23,386 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36369 2023-07-18 04:10:23,387 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36369 2023-07-18 04:10:23,394 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36369 2023-07-18 04:10:23,395 DEBUG [Listener at localhost/42327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36369 2023-07-18 04:10:23,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:23,413 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 04:10:23,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:23,441 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,441 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,442 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,441 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,442 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:23,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 04:10:23,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 04:10:23,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39993,1689653421600 from backup master directory 2023-07-18 04:10:23,450 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:23,450 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 04:10:23,451 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:23,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:23,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 04:10:23,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 04:10:23,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/hbase.id with ID: c7fce2eb-42bc-4017-b253-70d6415decf2 2023-07-18 04:10:23,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,660 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:23,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7ac0c05b to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:23,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d1c1587, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:23,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:23,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 04:10:23,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 04:10:23,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 04:10:23,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:23,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:23,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:23,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store-tmp 2023-07-18 04:10:23,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 04:10:23,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 04:10:23,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:10:23,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/WALs/jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:23,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39993%2C1689653421600, suffix=, logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/WALs/jenkins-hbase4.apache.org,39993,1689653421600, archiveDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/oldWALs, maxLogs=10 2023-07-18 04:10:24,063 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK] 2023-07-18 04:10:24,063 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK] 2023-07-18 04:10:24,063 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK] 2023-07-18 04:10:24,073 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:24,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/WALs/jenkins-hbase4.apache.org,39993,1689653421600/jenkins-hbase4.apache.org%2C39993%2C1689653421600.1689653423986 2023-07-18 04:10:24,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK], DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK]] 2023-07-18 04:10:24,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:24,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:24,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,270 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,278 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 04:10:24,319 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 04:10:24,336 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:24,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:24,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70748702, jitterRate=0.054237812757492065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:24,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:10:24,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 04:10:24,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 04:10:24,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 04:10:24,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 04:10:24,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 04:10:24,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-18 04:10:24,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 04:10:24,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 04:10:24,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 04:10:24,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 04:10:24,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 04:10:24,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 04:10:24,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 04:10:24,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 04:10:24,545 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 04:10:24,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 04:10:24,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 04:10:24,572 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,572 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39993,1689653421600, sessionid=0x101769fa5880000, setting cluster-up flag (Was=false) 2023-07-18 04:10:24,596 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 04:10:24,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:24,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 04:10:24,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:24,631 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp 2023-07-18 04:10:24,701 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(951): ClusterId : c7fce2eb-42bc-4017-b253-70d6415decf2 2023-07-18 04:10:24,701 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(951): ClusterId : c7fce2eb-42bc-4017-b253-70d6415decf2 2023-07-18 04:10:24,702 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(951): ClusterId : c7fce2eb-42bc-4017-b253-70d6415decf2 2023-07-18 04:10:24,710 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,710 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,710 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,719 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,719 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,719 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,719 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,719 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,720 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,732 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,745 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ReadOnlyZKClient(139): Connect 0x62c44d46 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,755 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,757 DEBUG [RS:1;jenkins-hbase4:34797] zookeeper.ReadOnlyZKClient(139): Connect 0x17494da9 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,757 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,764 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ReadOnlyZKClient(139): Connect 0x4189b66a to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 04:10:24,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 04:10:24,788 DEBUG [RS:1;jenkins-hbase4:34797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@524bd124, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,792 DEBUG [RS:1;jenkins-hbase4:34797] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4658a25a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,792 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b9ebf47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,793 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10755586, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,818 DEBUG [RS:0;jenkins-hbase4:40467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31515fcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,819 DEBUG [RS:0;jenkins-hbase4:40467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6034c4b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,836 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40467 2023-07-18 04:10:24,843 INFO [RS:0;jenkins-hbase4:40467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,843 INFO [RS:0;jenkins-hbase4:40467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,844 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,846 INFO [RS:0;jenkins-hbase4:40467] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,847 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,850 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39993,1689653421600 with isa=jenkins-hbase4.apache.org/172.31.14.131:40467, startcode=1689653423184 2023-07-18 04:10:24,873 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36369 2023-07-18 04:10:24,875 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34797 2023-07-18 04:10:24,874 INFO [RS:2;jenkins-hbase4:36369] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,876 INFO [RS:1;jenkins-hbase4:34797] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,876 INFO [RS:1;jenkins-hbase4:34797] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,876 INFO [RS:2;jenkins-hbase4:36369] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,876 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,876 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,876 INFO [RS:1;jenkins-hbase4:34797] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,877 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,877 INFO [RS:2;jenkins-hbase4:36369] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,877 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,879 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39993,1689653421600 with isa=jenkins-hbase4.apache.org/172.31.14.131:36369, startcode=1689653423335 2023-07-18 04:10:24,879 DEBUG [RS:2;jenkins-hbase4:36369] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,880 DEBUG [RS:0;jenkins-hbase4:40467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,881 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39993,1689653421600 with isa=jenkins-hbase4.apache.org/172.31.14.131:34797, startcode=1689653423262 2023-07-18 04:10:24,882 DEBUG [RS:1;jenkins-hbase4:34797] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:24,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:24,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689653454972 2023-07-18 04:10:24,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 04:10:24,978 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:24,979 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 04:10:24,984 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:24,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 04:10:24,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 04:10:24,997 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57637, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,997 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41211, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 04:10:24,997 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41177, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 04:10:24,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 04:10:25,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 04:10:25,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 04:10:25,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 04:10:25,018 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39993] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 04:10:25,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 04:10:25,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 04:10:25,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653425024,5,FailOnTimeoutGroup] 2023-07-18 04:10:25,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653425031,5,FailOnTimeoutGroup] 2023-07-18 04:10:25,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 04:10:25,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,063 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39993] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,066 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 04:10:25,066 WARN [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 04:10:25,081 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39993] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,081 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:25,081 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45769 2023-07-18 04:10:25,082 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,083 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:25,083 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45769 2023-07-18 04:10:25,083 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,098 DEBUG [RS:1;jenkins-hbase4:34797] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,099 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:10:25,099 WARN [RS:1;jenkins-hbase4:34797] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,101 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,102 WARN [RS:2;jenkins-hbase4:36369] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,102 INFO [RS:1;jenkins-hbase4:34797] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,102 INFO [RS:2;jenkins-hbase4:36369] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,102 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,103 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:25,103 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,104 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:25,104 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36369,1689653423335] 2023-07-18 04:10:25,105 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:25,114 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34797,1689653423262] 2023-07-18 04:10:25,146 DEBUG [RS:1;jenkins-hbase4:34797] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,147 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,152 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,153 DEBUG [RS:1;jenkins-hbase4:34797] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,168 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39993,1689653421600 with isa=jenkins-hbase4.apache.org/172.31.14.131:40467, startcode=1689653423184 2023-07-18 04:10:25,169 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39993] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,173 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,193 INFO [RS:1;jenkins-hbase4:34797] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,194 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,209 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:25,210 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45769 2023-07-18 04:10:25,210 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,213 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:10:25,213 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:10:25,213 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:10:25,216 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ZKUtil(162): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,216 WARN [RS:0;jenkins-hbase4:40467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,216 INFO [RS:0;jenkins-hbase4:40467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,216 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,217 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40467,1689653423184] 2023-07-18 04:10:25,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,221 INFO [RS:2;jenkins-hbase4:36369] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,244 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ZKUtil(162): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,245 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ZKUtil(162): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,246 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ZKUtil(162): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,249 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:25,250 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,251 INFO [RS:0;jenkins-hbase4:40467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,260 INFO [RS:0;jenkins-hbase4:40467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,267 INFO [RS:0;jenkins-hbase4:40467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,268 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,286 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,264 INFO [RS:1;jenkins-hbase4:34797] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 04:10:25,291 INFO [RS:2;jenkins-hbase4:36369] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,292 INFO [RS:1;jenkins-hbase4:34797] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,299 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,300 INFO [RS:2;jenkins-hbase4:36369] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,300 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,300 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,302 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,304 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/info 2023-07-18 04:10:25,305 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 04:10:25,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 04:10:25,310 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,311 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,312 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,312 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,313 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,313 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,313 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,313 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,314 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,315 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,315 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,315 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,315 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,314 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,315 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:0;jenkins-hbase4:40467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,316 DEBUG [RS:1;jenkins-hbase4:34797] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:25,322 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 04:10:25,323 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,323 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,323 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,342 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 04:10:25,343 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,343 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/table 2023-07-18 04:10:25,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 04:10:25,348 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,349 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,349 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,357 INFO [RS:2;jenkins-hbase4:36369] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,363 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740 2023-07-18 04:10:25,364 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36369,1689653423335-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,366 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740 2023-07-18 04:10:25,371 INFO [RS:1;jenkins-hbase4:34797] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,373 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34797,1689653423262-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,383 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 04:10:25,387 INFO [RS:0;jenkins-hbase4:40467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,387 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40467,1689653423184-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,387 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 04:10:25,402 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:25,404 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74747346, jitterRate=0.11382225155830383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 04:10:25,404 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 04:10:25,404 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 04:10:25,405 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 04:10:25,405 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 04:10:25,405 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 04:10:25,405 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 04:10:25,411 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 04:10:25,412 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 04:10:25,418 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:25,418 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 04:10:25,436 INFO [RS:1;jenkins-hbase4:34797] regionserver.Replication(203): jenkins-hbase4.apache.org,34797,1689653423262 started 2023-07-18 04:10:25,436 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34797,1689653423262, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34797, sessionid=0x101769fa5880002 2023-07-18 04:10:25,438 INFO [RS:0;jenkins-hbase4:40467] regionserver.Replication(203): jenkins-hbase4.apache.org,40467,1689653423184 started 2023-07-18 04:10:25,438 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40467,1689653423184, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40467, sessionid=0x101769fa5880001 2023-07-18 04:10:25,438 INFO [RS:2;jenkins-hbase4:36369] regionserver.Replication(203): jenkins-hbase4.apache.org,36369,1689653423335 started 2023-07-18 04:10:25,439 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,439 DEBUG [RS:1;jenkins-hbase4:34797] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,439 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,439 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36369,1689653423335, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36369, sessionid=0x101769fa5880003 2023-07-18 04:10:25,439 DEBUG [RS:0;jenkins-hbase4:40467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,440 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,439 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34797,1689653423262' 2023-07-18 04:10:25,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 04:10:25,441 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,441 DEBUG [RS:2;jenkins-hbase4:36369] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,440 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40467,1689653423184' 2023-07-18 04:10:25,441 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,441 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36369,1689653423335' 2023-07-18 04:10:25,442 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,442 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,443 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,443 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,443 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,443 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,444 DEBUG [RS:1;jenkins-hbase4:34797] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:25,444 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,444 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34797,1689653423262' 2023-07-18 04:10:25,444 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,444 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,444 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,444 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,445 DEBUG [RS:1;jenkins-hbase4:34797] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,444 DEBUG [RS:0;jenkins-hbase4:40467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,444 DEBUG [RS:2;jenkins-hbase4:36369] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:25,446 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36369,1689653423335' 2023-07-18 04:10:25,446 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,446 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40467,1689653423184' 2023-07-18 04:10:25,446 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,447 DEBUG [RS:1;jenkins-hbase4:34797] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,447 DEBUG [RS:0;jenkins-hbase4:40467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,447 INFO [RS:1;jenkins-hbase4:34797] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,447 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,447 INFO [RS:1;jenkins-hbase4:34797] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,448 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,448 INFO [RS:2;jenkins-hbase4:36369] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,449 INFO [RS:2;jenkins-hbase4:36369] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,450 DEBUG [RS:0;jenkins-hbase4:40467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,450 INFO [RS:0;jenkins-hbase4:40467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,451 INFO [RS:0;jenkins-hbase4:40467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,458 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 04:10:25,461 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 04:10:25,563 INFO [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40467%2C1689653423184, suffix=, logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,40467,1689653423184, archiveDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs, maxLogs=32 2023-07-18 04:10:25,564 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36369%2C1689653423335, suffix=, logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,36369,1689653423335, archiveDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs, maxLogs=32 2023-07-18 04:10:25,565 INFO [RS:1;jenkins-hbase4:34797] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34797%2C1689653423262, suffix=, logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,34797,1689653423262, archiveDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs, maxLogs=32 2023-07-18 04:10:25,597 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK] 2023-07-18 04:10:25,597 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK] 2023-07-18 04:10:25,613 DEBUG [jenkins-hbase4:39993] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 04:10:25,619 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK] 2023-07-18 04:10:25,619 DEBUG [jenkins-hbase4:39993] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:25,636 DEBUG [jenkins-hbase4:39993] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:25,636 DEBUG [jenkins-hbase4:39993] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:25,636 DEBUG [jenkins-hbase4:39993] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:25,636 DEBUG [jenkins-hbase4:39993] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:25,638 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK] 2023-07-18 04:10:25,639 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK] 2023-07-18 04:10:25,662 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40467,1689653423184, state=OPENING 2023-07-18 04:10:25,673 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK] 2023-07-18 04:10:25,675 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK] 2023-07-18 04:10:25,681 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 04:10:25,683 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK] 2023-07-18 04:10:25,685 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:25,686 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 04:10:25,683 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK] 2023-07-18 04:10:25,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:10:25,712 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,36369,1689653423335/jenkins-hbase4.apache.org%2C36369%2C1689653423335.1689653425570 2023-07-18 04:10:25,712 INFO [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,40467,1689653423184/jenkins-hbase4.apache.org%2C40467%2C1689653423184.1689653425570 2023-07-18 04:10:25,713 INFO [RS:1;jenkins-hbase4:34797] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,34797,1689653423262/jenkins-hbase4.apache.org%2C34797%2C1689653423262.1689653425570 2023-07-18 04:10:25,715 DEBUG [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK], DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK]] 2023-07-18 04:10:25,722 DEBUG [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK], DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK]] 2023-07-18 04:10:25,727 DEBUG [RS:1;jenkins-hbase4:34797] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK], DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK]] 2023-07-18 04:10:25,920 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:25,923 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:25,928 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:25,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 04:10:25,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40467%2C1689653423184.meta, suffix=.meta, logDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,40467,1689653423184, archiveDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs, maxLogs=32 2023-07-18 04:10:25,978 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK] 2023-07-18 04:10:25,981 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK] 2023-07-18 04:10:25,981 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK] 2023-07-18 04:10:25,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/WALs/jenkins-hbase4.apache.org,40467,1689653423184/jenkins-hbase4.apache.org%2C40467%2C1689653423184.meta.1689653425954.meta 2023-07-18 04:10:25,993 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35077,DS-79235424-fc67-4e02-8e41-eec1d95b0d90,DISK], DatanodeInfoWithStorage[127.0.0.1:33903,DS-f5b5e0b0-f824-4ad7-a42f-2bef8ddeacc4,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-079525c5-3c70-487a-a83d-610becf62247,DISK]] 2023-07-18 04:10:25,993 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:25,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 04:10:25,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:25,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 04:10:26,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 04:10:26,003 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 04:10:26,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 04:10:26,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:26,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 04:10:26,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 04:10:26,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 04:10:26,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/info 2023-07-18 04:10:26,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/info 2023-07-18 04:10:26,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 04:10:26,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:26,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 04:10:26,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:26,034 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:26,034 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 04:10:26,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:26,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 04:10:26,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/table 2023-07-18 04:10:26,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/table 2023-07-18 04:10:26,038 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 04:10:26,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:26,041 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740 2023-07-18 04:10:26,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740 2023-07-18 04:10:26,047 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 04:10:26,051 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 04:10:26,054 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59960072, jitterRate=-0.10652530193328857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 04:10:26,061 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 04:10:26,072 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689653425908 2023-07-18 04:10:26,096 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40467,1689653423184, state=OPEN 2023-07-18 04:10:26,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 04:10:26,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 04:10:26,099 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 04:10:26,100 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 04:10:26,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 04:10:26,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40467,1689653423184 in 408 msec 2023-07-18 04:10:26,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 04:10:26,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 667 msec 2023-07-18 04:10:26,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3330 sec 2023-07-18 04:10:26,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689653426119, completionTime=-1 2023-07-18 04:10:26,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 04:10:26,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 04:10:26,219 DEBUG [hconnection-0x79c8fad-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:26,223 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:26,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 04:10:26,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689653486251 2023-07-18 04:10:26,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689653546251 2023-07-18 04:10:26,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 132 msec 2023-07-18 04:10:26,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39993,1689653421600-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39993,1689653421600-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39993,1689653421600-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39993, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,295 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 04:10:26,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 04:10:26,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:26,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 04:10:26,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:26,329 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:26,350 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,353 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4 empty. 2023-07-18 04:10:26,354 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,354 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 04:10:26,400 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:26,403 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4541fbbe8eb478f581565f5e2ef604d4, NAME => 'hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4541fbbe8eb478f581565f5e2ef604d4, disabling compactions & flushes 2023-07-18 04:10:26,425 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. after waiting 0 ms 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,425 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,425 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4541fbbe8eb478f581565f5e2ef604d4: 2023-07-18 04:10:26,432 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:26,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653426435"}]},"ts":"1689653426435"} 2023-07-18 04:10:26,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 04:10:26,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:26,496 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653426490"}]},"ts":"1689653426490"} 2023-07-18 04:10:26,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 04:10:26,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:26,513 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:26,514 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:26,514 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:26,514 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:26,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4541fbbe8eb478f581565f5e2ef604d4, ASSIGN}] 2023-07-18 04:10:26,520 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4541fbbe8eb478f581565f5e2ef604d4, ASSIGN 2023-07-18 04:10:26,523 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4541fbbe8eb478f581565f5e2ef604d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:10:26,681 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:10:26,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4541fbbe8eb478f581565f5e2ef604d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:26,682 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653426681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653426681"}]},"ts":"1689653426681"} 2023-07-18 04:10:26,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4541fbbe8eb478f581565f5e2ef604d4, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:10:26,841 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:26,842 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:26,845 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:26,852 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4541fbbe8eb478f581565f5e2ef604d4, NAME => 'hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:26,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. service=AccessControlService 2023-07-18 04:10:26,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:26,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:26,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,858 INFO [StoreOpener-4541fbbe8eb478f581565f5e2ef604d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,860 DEBUG [StoreOpener-4541fbbe8eb478f581565f5e2ef604d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/info 2023-07-18 04:10:26,860 DEBUG [StoreOpener-4541fbbe8eb478f581565f5e2ef604d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/info 2023-07-18 04:10:26,861 INFO [StoreOpener-4541fbbe8eb478f581565f5e2ef604d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4541fbbe8eb478f581565f5e2ef604d4 columnFamilyName info 2023-07-18 04:10:26,863 INFO [StoreOpener-4541fbbe8eb478f581565f5e2ef604d4-1] regionserver.HStore(310): Store=4541fbbe8eb478f581565f5e2ef604d4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:26,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:10:26,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:26,881 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4541fbbe8eb478f581565f5e2ef604d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73167756, jitterRate=0.09028452634811401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:26,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4541fbbe8eb478f581565f5e2ef604d4: 2023-07-18 04:10:26,883 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4., pid=6, masterSystemTime=1689653426841 2023-07-18 04:10:26,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,890 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:10:26,891 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4541fbbe8eb478f581565f5e2ef604d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:26,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426891"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653426891"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653426891"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653426891"}]},"ts":"1689653426891"} 2023-07-18 04:10:26,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 04:10:26,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4541fbbe8eb478f581565f5e2ef604d4, server=jenkins-hbase4.apache.org,34797,1689653423262 in 211 msec 2023-07-18 04:10:26,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 04:10:26,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4541fbbe8eb478f581565f5e2ef604d4, ASSIGN in 386 msec 2023-07-18 04:10:26,911 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:26,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653426911"}]},"ts":"1689653426911"} 2023-07-18 04:10:26,914 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 04:10:26,918 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:26,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 607 msec 2023-07-18 04:10:26,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 04:10:26,926 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:26,926 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:26,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:26,951 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:26,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 04:10:26,990 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:26,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-18 04:10:27,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 04:10:27,015 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:27,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-18 04:10:27,039 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 04:10:27,041 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 04:10:27,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.590sec 2023-07-18 04:10:27,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 04:10:27,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 04:10:27,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 04:10:27,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39993,1689653421600-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 04:10:27,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39993,1689653421600-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 04:10:27,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:27,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 04:10:27,086 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:27,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:27,091 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 04:10:27,092 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f empty. 2023-07-18 04:10:27,095 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,095 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 04:10:27,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,109 DEBUG [Listener at localhost/42327] zookeeper.ReadOnlyZKClient(139): Connect 0x417fc4db to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:27,123 DEBUG [Listener at localhost/42327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6591ae65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:27,132 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:27,137 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec8a6e6a3ac1524ea65ff671e9675b2f, NAME => 'hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:27,173 DEBUG [hconnection-0x25f7a1db-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:27,191 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:27,192 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ec8a6e6a3ac1524ea65ff671e9675b2f, disabling compactions & flushes 2023-07-18 04:10:27,192 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,192 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,192 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. after waiting 0 ms 2023-07-18 04:10:27,192 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,192 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,192 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ec8a6e6a3ac1524ea65ff671e9675b2f: 2023-07-18 04:10:27,199 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:27,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653427201"}]},"ts":"1689653427201"} 2023-07-18 04:10:27,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:27,205 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 04:10:27,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:27,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653427207"}]},"ts":"1689653427207"} 2023-07-18 04:10:27,207 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/test.cache.data in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop.log.dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:27,208 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/nfs.dump.dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 04:10:27,209 INFO [Listener at localhost/42327] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 04:10:27,217 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 04:10:27,222 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:27,224 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:27,224 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:27,224 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:27,224 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:27,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec8a6e6a3ac1524ea65ff671e9675b2f, ASSIGN}] 2023-07-18 04:10:27,227 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec8a6e6a3ac1524ea65ff671e9675b2f, ASSIGN 2023-07-18 04:10:27,229 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ec8a6e6a3ac1524ea65ff671e9675b2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:10:27,379 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:10:27,381 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec8a6e6a3ac1524ea65ff671e9675b2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:27,381 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653427381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653427381"}]},"ts":"1689653427381"} 2023-07-18 04:10:27,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ec8a6e6a3ac1524ea65ff671e9675b2f, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:10:27,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,564 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec8a6e6a3ac1524ea65ff671e9675b2f, NAME => 'hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:27,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. service=AccessControlService 2023-07-18 04:10:27,565 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:27,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:27,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,575 INFO [StoreOpener-ec8a6e6a3ac1524ea65ff671e9675b2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,579 DEBUG [StoreOpener-ec8a6e6a3ac1524ea65ff671e9675b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/l 2023-07-18 04:10:27,579 DEBUG [StoreOpener-ec8a6e6a3ac1524ea65ff671e9675b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/l 2023-07-18 04:10:27,579 INFO [StoreOpener-ec8a6e6a3ac1524ea65ff671e9675b2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec8a6e6a3ac1524ea65ff671e9675b2f columnFamilyName l 2023-07-18 04:10:27,581 INFO [StoreOpener-ec8a6e6a3ac1524ea65ff671e9675b2f-1] regionserver.HStore(310): Store=ec8a6e6a3ac1524ea65ff671e9675b2f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:27,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:10:27,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:27,598 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec8a6e6a3ac1524ea65ff671e9675b2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72641731, jitterRate=0.0824461430311203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:27,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec8a6e6a3ac1524ea65ff671e9675b2f: 2023-07-18 04:10:27,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f., pid=11, masterSystemTime=1689653427541 2023-07-18 04:10:27,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,603 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:10:27,604 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec8a6e6a3ac1524ea65ff671e9675b2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:27,605 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653427604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653427604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653427604"}]},"ts":"1689653427604"} 2023-07-18 04:10:27,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 04:10:27,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ec8a6e6a3ac1524ea65ff671e9675b2f, server=jenkins-hbase4.apache.org,34797,1689653423262 in 227 msec 2023-07-18 04:10:27,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 04:10:27,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ec8a6e6a3ac1524ea65ff671e9675b2f, ASSIGN in 394 msec 2023-07-18 04:10:27,626 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:27,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653427626"}]},"ts":"1689653427626"} 2023-07-18 04:10:27,630 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 04:10:27,634 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:27,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 554 msec 2023-07-18 04:10:27,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 04:10:27,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 04:10:28,514 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:28,812 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:28,817 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46671_jobhistory____.gfy83t/webapp 2023-07-18 04:10:28,984 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 04:10:28,984 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:28,985 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:28,987 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:29,057 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:29,365 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:29,810 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 04:10:29,869 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46671 2023-07-18 04:10:31,510 WARN [Listener at jenkins-hbase4.apache.org/38441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:31,724 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:10:31,809 WARN [Listener at jenkins-hbase4.apache.org/38441] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:31,810 INFO [Listener at jenkins-hbase4.apache.org/38441] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:31,825 INFO [Listener at jenkins-hbase4.apache.org/38441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46479_cluster____.2sibe8/webapp 2023-07-18 04:10:31,829 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 04:10:31,832 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 04:10:31,833 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 04:10:31,835 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,835 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 04:10:31,836 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,836 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 04:10:31,836 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 04:10:31,836 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 04:10:31,836 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,836 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 04:10:31,837 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 04:10:31,837 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 04:10:31,902 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:31,902 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 04:10:31,902 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:31,903 INFO [Listener at jenkins-hbase4.apache.org/38441] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:31,913 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,108 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,245 INFO [Listener at jenkins-hbase4.apache.org/38441] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,255 INFO [Listener at jenkins-hbase4.apache.org/38441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46479 2023-07-18 04:10:32,703 WARN [Listener at jenkins-hbase4.apache.org/44357] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:32,729 WARN [Listener at jenkins-hbase4.apache.org/44357] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:32,730 INFO [Listener at jenkins-hbase4.apache.org/44357] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:32,738 INFO [Listener at jenkins-hbase4.apache.org/44357] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45079_node____.l5xaz5/webapp 2023-07-18 04:10:32,803 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 04:10:32,803 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:32,804 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:32,804 INFO [Listener at jenkins-hbase4.apache.org/44357] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:32,816 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,840 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,930 INFO [Listener at jenkins-hbase4.apache.org/44357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:32,952 INFO [Listener at jenkins-hbase4.apache.org/44357] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45079 2023-07-18 04:10:33,116 WARN [Listener at jenkins-hbase4.apache.org/36671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:33,125 WARN [Listener at jenkins-hbase4.apache.org/36671] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:33,125 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:33,132 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44033_node____qznw3y/webapp 2023-07-18 04:10:33,186 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 04:10:33,186 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:33,186 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:33,186 INFO [Listener at jenkins-hbase4.apache.org/36671] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:33,194 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:33,206 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:33,270 INFO [Listener at jenkins-hbase4.apache.org/36671] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:33,278 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44033 2023-07-18 04:10:33,307 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 04:10:33,309 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:33,398 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=175, AvailableMemoryMB=4829 2023-07-18 04:10:33,399 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-18 04:10:33,412 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 04:10:33,419 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 04:10:33,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:33,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:33,435 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:33,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 04:10:33,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:33,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:33,443 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,443 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,445 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce empty. 2023-07-18 04:10:33,445 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 empty. 2023-07-18 04:10:33,446 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,446 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 04:10:33,493 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:33,495 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba3efb4b969921a2a26de07bc473e0ce, NAME => 'testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:33,495 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 675c33556b4421165d8405cddb088171, NAME => 'testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:33,537 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:33,538 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ba3efb4b969921a2a26de07bc473e0ce, disabling compactions & flushes 2023-07-18 04:10:33,538 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:33,538 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:33,538 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. after waiting 0 ms 2023-07-18 04:10:33,538 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:33,538 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:33,538 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ba3efb4b969921a2a26de07bc473e0ce: 2023-07-18 04:10:33,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 675c33556b4421165d8405cddb088171, disabling compactions & flushes 2023-07-18 04:10:33,541 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. after waiting 0 ms 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,541 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,541 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 675c33556b4421165d8405cddb088171: 2023-07-18 04:10:33,546 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:33,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653433547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653433547"}]},"ts":"1689653433547"} 2023-07-18 04:10:33,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653433547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653433547"}]},"ts":"1689653433547"} 2023-07-18 04:10:33,603 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:10:33,607 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:33,608 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653433608"}]},"ts":"1689653433608"} 2023-07-18 04:10:33,610 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 04:10:33,620 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:33,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:33,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:33,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:33,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:33,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, ASSIGN}] 2023-07-18 04:10:33,626 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, ASSIGN 2023-07-18 04:10:33,626 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, ASSIGN 2023-07-18 04:10:33,628 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:10:33,628 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40467,1689653423184; forceNewPlan=false, retain=false 2023-07-18 04:10:33,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:33,778 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:10:33,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=675c33556b4421165d8405cddb088171, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:33,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ba3efb4b969921a2a26de07bc473e0ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:33,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653433781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653433781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653433781"}]},"ts":"1689653433781"} 2023-07-18 04:10:33,782 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653433781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653433781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653433781"}]},"ts":"1689653433781"} 2023-07-18 04:10:33,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 675c33556b4421165d8405cddb088171, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:10:33,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure ba3efb4b969921a2a26de07bc473e0ce, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:10:33,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 675c33556b4421165d8405cddb088171, NAME => 'testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:10:33,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. service=AccessControlService 2023-07-18 04:10:33,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:33,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:33,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,946 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:33,947 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:33,947 INFO [StoreOpener-675c33556b4421165d8405cddb088171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,948 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:33,950 DEBUG [StoreOpener-675c33556b4421165d8405cddb088171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf 2023-07-18 04:10:33,950 DEBUG [StoreOpener-675c33556b4421165d8405cddb088171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf 2023-07-18 04:10:33,951 INFO [StoreOpener-675c33556b4421165d8405cddb088171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 675c33556b4421165d8405cddb088171 columnFamilyName cf 2023-07-18 04:10:33,951 INFO [StoreOpener-675c33556b4421165d8405cddb088171-1] regionserver.HStore(310): Store=675c33556b4421165d8405cddb088171/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:33,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:33,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba3efb4b969921a2a26de07bc473e0ce, NAME => 'testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:10:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. service=AccessControlService 2023-07-18 04:10:33,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,957 INFO [StoreOpener-ba3efb4b969921a2a26de07bc473e0ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 675c33556b4421165d8405cddb088171 2023-07-18 04:10:33,960 DEBUG [StoreOpener-ba3efb4b969921a2a26de07bc473e0ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf 2023-07-18 04:10:33,960 DEBUG [StoreOpener-ba3efb4b969921a2a26de07bc473e0ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf 2023-07-18 04:10:33,960 INFO [StoreOpener-ba3efb4b969921a2a26de07bc473e0ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3efb4b969921a2a26de07bc473e0ce columnFamilyName cf 2023-07-18 04:10:33,961 INFO [StoreOpener-ba3efb4b969921a2a26de07bc473e0ce-1] regionserver.HStore(310): Store=ba3efb4b969921a2a26de07bc473e0ce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:33,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:33,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 675c33556b4421165d8405cddb088171; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68651762, jitterRate=0.02299097180366516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:33,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 675c33556b4421165d8405cddb088171: 2023-07-18 04:10:33,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171., pid=15, masterSystemTime=1689653433937 2023-07-18 04:10:33,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:33,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:33,979 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=675c33556b4421165d8405cddb088171, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:33,979 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653433979"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653433979"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653433979"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653433979"}]},"ts":"1689653433979"} 2023-07-18 04:10:33,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:33,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba3efb4b969921a2a26de07bc473e0ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74012189, jitterRate=0.10286755859851837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:33,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba3efb4b969921a2a26de07bc473e0ce: 2023-07-18 04:10:33,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce., pid=16, masterSystemTime=1689653433946 2023-07-18 04:10:33,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-18 04:10:33,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 675c33556b4421165d8405cddb088171, server=jenkins-hbase4.apache.org,40467,1689653423184 in 199 msec 2023-07-18 04:10:33,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:34,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, ASSIGN in 372 msec 2023-07-18 04:10:34,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:34,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ba3efb4b969921a2a26de07bc473e0ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,000 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653434000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653434000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653434000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653434000"}]},"ts":"1689653434000"} 2023-07-18 04:10:34,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-18 04:10:34,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure ba3efb4b969921a2a26de07bc473e0ce, server=jenkins-hbase4.apache.org,36369,1689653423335 in 213 msec 2023-07-18 04:10:34,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 04:10:34,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, ASSIGN in 384 msec 2023-07-18 04:10:34,012 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:34,013 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653434012"}]},"ts":"1689653434012"} 2023-07-18 04:10:34,015 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 04:10:34,018 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:34,023 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 04:10:34,034 DEBUG [hconnection-0x5ddfda1b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:34,038 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-18 04:10:34,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:34,047 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:34,087 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:34,087 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:34,087 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:34,087 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:34,088 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:34,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:34,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:34,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:34,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:34,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 674 msec 2023-07-18 04:10:34,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:34,546 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 04:10:34,546 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-18 04:10:34,548 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:34,554 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-18 04:10:34,555 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:34,555 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-18 04:10:34,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653434576 (current time:1689653434576). 2023-07-18 04:10:34,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:34,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x74049efa to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:34,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f79c02c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:34,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:34,600 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74049efa to 127.0.0.1:52746 2023-07-18 04:10:34,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:34,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x1a2c996f to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a43984b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:34,638 DEBUG [hconnection-0x55909357-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:34,639 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:34,648 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:34,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a2c996f to 127.0.0.1:52746 2023-07-18 04:10:34,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:34,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:34,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:34,712 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:34,718 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689654034717 2023-07-18 04:10:34,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:34,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 04:10:34,724 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:34,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:34,726 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:34,727 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:34,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 26 msec 2023-07-18 04:10:34,729 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:34,730 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689654034730 2023-07-18 04:10:34,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,770 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 04:10:34,770 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:34,771 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 04:10:34,771 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 04:10:34,772 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,772 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,777 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,777 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,778 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,778 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,779 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,779 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:34,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:34,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:34,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,784 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,786 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:34,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:34,793 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:34,796 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:34,797 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:34,797 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:34,797 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:34,800 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,801 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,802 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:34,802 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,802 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:34,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e444752[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:34,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e444752[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:34,810 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 04:10:34,810 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,813 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,813 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:34,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:34,815 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:34,815 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:10:34,815 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,815 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:34,819 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:34,819 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,820 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:34,821 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:34,821 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:34,822 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. started... 2023-07-18 04:10:34,822 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. started... 2023-07-18 04:10:34,825 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba3efb4b969921a2a26de07bc473e0ce: 2023-07-18 04:10:34,825 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 675c33556b4421165d8405cddb088171: 2023-07-18 04:10:34,827 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,827 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,827 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:34,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:34,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:34,833 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:34,834 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:34,834 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:34,840 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:34,840 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:34,882 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. completed. 2023-07-18 04:10:34,882 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:34,882 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. completed. 2023-07-18 04:10:34,882 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:34,882 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:34,883 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:10:34,885 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,885 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,885 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,885 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:34,887 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:34,887 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,887 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:34,887 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:10:34,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 04:10:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:10:34,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 04:10:34,900 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 04:10:34,901 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:34,901 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:34,901 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,901 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,907 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,907 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,908 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,912 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,913 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,913 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:34,930 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:34,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:34,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:34,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:35,033 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:35,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:35,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:35,035 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:10:35,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 04:10:35,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:35,046 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:35,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689653434721Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689653434931 (+210 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689653434932 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689653434945 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689653434975 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689653435045 (+70 ms) 2023-07-18 04:10:35,048 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:35,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 323 msec 2023-07-18 04:10:35,336 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:35,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:35,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:35,361 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:35,369 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:35,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:35,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40467] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:35,378 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 04:10:35,379 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:35,381 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:35,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:35,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653435422 (current time:1689653435422). 2023-07-18 04:10:35,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:35,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x45b658d8 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:35,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fff03a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:35,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:35,447 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:35,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45b658d8 to 127.0.0.1:52746 2023-07-18 04:10:35,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:35,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x09949c9d to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:35,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e9375ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:35,459 DEBUG [hconnection-0x19168b8c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:35,461 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:35,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:35,469 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09949c9d to 127.0.0.1:52746 2023-07-18 04:10:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:35,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:35,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:35,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:35,478 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:35,479 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689654035479 2023-07-18 04:10:35,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:35,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 04:10:35,480 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:35,481 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:35,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:35,483 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:35,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-18 04:10:35,486 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:35,487 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689654035487 2023-07-18 04:10:35,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 04:10:35,528 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 04:10:35,529 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:35,530 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 04:10:35,530 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 04:10:35,531 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,531 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,533 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:35,533 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:35,533 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:35,534 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,534 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,535 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,535 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,544 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:35,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:35,544 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:35,544 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:35,546 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:35,546 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:35,546 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:35,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:35,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:35,548 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:35,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:35,549 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:35,549 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:35,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:35,551 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:35,551 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:35,550 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:35,551 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:35,551 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:35,552 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:35,554 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,554 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,555 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:35,555 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,555 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,556 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:35,556 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:35,557 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,557 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:35,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:35,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:35,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:35,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232d9bfe[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:35,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:35,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:35,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232d9bfe[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:35,567 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 04:10:35,567 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,573 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:35,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:35,574 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:35,575 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:35,575 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. started... 2023-07-18 04:10:35,575 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 675c33556b4421165d8405cddb088171 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 04:10:35,578 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:35,578 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:35,579 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:35,579 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,579 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. started... 2023-07-18 04:10:35,579 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba3efb4b969921a2a26de07bc473e0ce 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 04:10:35,581 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:35,583 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:35,583 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:35,583 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:35,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:35,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:35,586 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:35,739 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/.tmp/cf/6fa08616894641ee96e2b0002d38f043 2023-07-18 04:10:35,786 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:35,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:35,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:35,788 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:10:35,803 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/.tmp/cf/6fa08616894641ee96e2b0002d38f043 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043 2023-07-18 04:10:35,814 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 04:10:35,816 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ba3efb4b969921a2a26de07bc473e0ce in 237ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:35,816 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 04:10:35,817 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba3efb4b969921a2a26de07bc473e0ce: 2023-07-18 04:10:35,818 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:35,818 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:35,818 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043] hfiles 2023-07-18 04:10:35,818 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:35,841 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. completed. 2023-07-18 04:10:35,841 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:35,841 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:35,842 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:10:35,844 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,844 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:35,844 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:35,844 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:35,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:35,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:10:35,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 04:10:36,089 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:36,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:36,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:36,091 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:10:36,144 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/.tmp/cf/34eec470c2b34f55b80a39109edf5f1f 2023-07-18 04:10:36,154 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/.tmp/cf/34eec470c2b34f55b80a39109edf5f1f as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f 2023-07-18 04:10:36,162 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 04:10:36,165 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 675c33556b4421165d8405cddb088171 in 590ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:36,166 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 675c33556b4421165d8405cddb088171: 2023-07-18 04:10:36,167 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:36,167 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:36,167 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f] hfiles 2023-07-18 04:10:36,167 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:36,184 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. completed. 2023-07-18 04:10:36,184 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:36,184 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:36,185 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:36,185 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,185 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:36,185 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:10:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:36,187 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:36,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:36,187 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:36,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:36,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:36,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:36,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:36,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:36,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:10:36,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 04:10:36,193 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 04:10:36,193 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:36,193 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:36,194 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 04:10:36,194 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:36,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,197 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,197 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:36,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,198 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:36,199 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:36,200 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,203 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:36,203 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,204 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:36,215 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:36,215 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:36,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:36,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 04:10:36,215 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 04:10:36,215 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:36,216 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:36,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,218 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:36,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-18 04:10:36,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 04:10:36,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,298 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:36,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689653435479Consolidate snapshot: snaptb0-testExportWithTargetName at 1689653436216 (+737 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689653436216Writing data manifest for snaptb0-testExportWithTargetName at 1689653436224 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689653436245 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689653436297 (+52 ms) 2023-07-18 04:10:36,300 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:36,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 820 msec 2023-07-18 04:10:36,591 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:36,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:36,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:36,594 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594 2023-07-18 04:10:36,595 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45769, tgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594, rawTgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:36,637 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-110242112_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 04:10:36,637 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 04:10:36,662 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 04:10:36,804 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,805 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,806 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,806 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,807 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,807 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,808 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,899 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-1949166369531178346.jar 2023-07-18 04:10:36,899 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,900 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,901 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,901 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,902 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,903 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:36,904 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:10:36,904 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:10:36,905 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:10:36,906 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:10:36,915 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:10:36,915 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:10:36,916 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:10:36,917 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:10:36,917 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:10:36,918 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:10:36,926 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:36,927 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:36,927 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:36,928 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:36,928 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:36,929 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:36,930 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:37,979 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:10:37,986 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 04:10:37,994 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 04:10:38,492 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:38,494 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:39,254 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:39,460 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:10:44,255 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:46,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:50,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:51,892 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:10:51,895 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:10:51,906 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 04:10:51,906 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:10:51,907 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:10:51,907 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 04:10:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 04:10:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 04:10:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/testExportWithTargetName 2023-07-18 04:10:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 04:10:51,908 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653436594/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 04:10:51,920 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 04:10:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 04:10:51,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:51,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653451941"}]},"ts":"1689653451941"} 2023-07-18 04:10:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:51,943 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 04:10:51,945 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 04:10:51,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, UNASSIGN}] 2023-07-18 04:10:51,949 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, UNASSIGN 2023-07-18 04:10:51,949 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, UNASSIGN 2023-07-18 04:10:51,950 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ba3efb4b969921a2a26de07bc473e0ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:51,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=675c33556b4421165d8405cddb088171, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:51,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653451950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653451950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653451950"}]},"ts":"1689653451950"} 2023-07-18 04:10:51,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653451950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653451950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653451950"}]},"ts":"1689653451950"} 2023-07-18 04:10:51,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 675c33556b4421165d8405cddb088171, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:10:51,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure ba3efb4b969921a2a26de07bc473e0ce, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:10:52,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:52,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:52,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 675c33556b4421165d8405cddb088171 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba3efb4b969921a2a26de07bc473e0ce, disabling compactions & flushes 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 675c33556b4421165d8405cddb088171, disabling compactions & flushes 2023-07-18 04:10:52,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:52,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. after waiting 0 ms 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. after waiting 0 ms 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:52,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:52,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:10:52,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:10:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:52,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:52,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce. 2023-07-18 04:10:52,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171. 2023-07-18 04:10:52,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba3efb4b969921a2a26de07bc473e0ce: 2023-07-18 04:10:52,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 675c33556b4421165d8405cddb088171: 2023-07-18 04:10:52,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 675c33556b4421165d8405cddb088171 2023-07-18 04:10:52,137 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=675c33556b4421165d8405cddb088171, regionState=CLOSED 2023-07-18 04:10:52,137 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653452137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653452137"}]},"ts":"1689653452137"} 2023-07-18 04:10:52,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:52,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ba3efb4b969921a2a26de07bc473e0ce, regionState=CLOSED 2023-07-18 04:10:52,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653452138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653452138"}]},"ts":"1689653452138"} 2023-07-18 04:10:52,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-18 04:10:52,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 675c33556b4421165d8405cddb088171, server=jenkins-hbase4.apache.org,40467,1689653423184 in 190 msec 2023-07-18 04:10:52,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-18 04:10:52,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure ba3efb4b969921a2a26de07bc473e0ce, server=jenkins-hbase4.apache.org,36369,1689653423335 in 190 msec 2023-07-18 04:10:52,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=675c33556b4421165d8405cddb088171, UNASSIGN in 199 msec 2023-07-18 04:10:52,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-18 04:10:52,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ba3efb4b969921a2a26de07bc473e0ce, UNASSIGN in 199 msec 2023-07-18 04:10:52,149 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653452149"}]},"ts":"1689653452149"} 2023-07-18 04:10:52,150 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 04:10:52,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:52,275 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 04:10:52,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 348 msec 2023-07-18 04:10:52,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:52,546 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 04:10:52,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 04:10:52,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,560 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 04:10:52,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,565 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 04:10:52,570 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:52,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:52,573 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/recovered.edits] 2023-07-18 04:10:52,573 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/recovered.edits] 2023-07-18 04:10:52,581 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/cf/6fa08616894641ee96e2b0002d38f043 2023-07-18 04:10:52,581 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/cf/34eec470c2b34f55b80a39109edf5f1f 2023-07-18 04:10:52,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce/recovered.edits/9.seqid 2023-07-18 04:10:52,585 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171/recovered.edits/9.seqid 2023-07-18 04:10:52,585 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/ba3efb4b969921a2a26de07bc473e0ce 2023-07-18 04:10:52,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportWithTargetName/675c33556b4421165d8405cddb088171 2023-07-18 04:10:52,586 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 04:10:52,589 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,610 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 04:10:52,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 04:10:52,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 04:10:52,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653452616"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:52,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653452616"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:52,619 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:10:52,619 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba3efb4b969921a2a26de07bc473e0ce, NAME => 'testtb-testExportWithTargetName,,1689653433428.ba3efb4b969921a2a26de07bc473e0ce.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 675c33556b4421165d8405cddb088171, NAME => 'testtb-testExportWithTargetName,1,1689653433428.675c33556b4421165d8405cddb088171.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:10:52,619 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 04:10:52,619 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653452619"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:52,621 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 04:10:52,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:52,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 141 msec 2023-07-18 04:10:52,791 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:52,791 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:52,791 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:52,791 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:52,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:52,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:52,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 04:10:52,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 04:10:52,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 04:10:52,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-18 04:10:52,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:52,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:52,860 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:10:52,860 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:10:52,860 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:10:52,860 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:10:52,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 04:10:52,864 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 04:10:52,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 04:10:52,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:52,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 04:10:52,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 04:10:52,920 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=757 (was 709) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1516898236_1 at /127.0.0.1:57222 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:57150 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1516898236_1 at /127.0.0.1:60830 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:42463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:36671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:51180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:46875 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:49656 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3014 (was 4829) 2023-07-18 04:10:52,920 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-18 04:10:52,940 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=181, AvailableMemoryMB=3013 2023-07-18 04:10:52,940 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-18 04:10:52,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:52,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:10:52,947 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:52,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 04:10:52,949 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:52,951 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:52,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:52,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 empty. 2023-07-18 04:10:52,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b empty. 2023-07-18 04:10:52,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:52,953 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:52,953 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 04:10:52,964 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:52,965 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 84d06c3be0f95200d530c37f98e38277, NAME => 'testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:52,965 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0b4a2d56837f9c6363042980728d586b, NAME => 'testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:10:52,977 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 84d06c3be0f95200d530c37f98e38277, disabling compactions & flushes 2023-07-18 04:10:52,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. after waiting 0 ms 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:52,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 84d06c3be0f95200d530c37f98e38277: 2023-07-18 04:10:52,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:52,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0b4a2d56837f9c6363042980728d586b, disabling compactions & flushes 2023-07-18 04:10:52,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:52,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:52,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. after waiting 0 ms 2023-07-18 04:10:52,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:52,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:52,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0b4a2d56837f9c6363042980728d586b: 2023-07-18 04:10:52,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:52,984 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653452983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653452983"}]},"ts":"1689653452983"} 2023-07-18 04:10:52,984 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653452983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653452983"}]},"ts":"1689653452983"} 2023-07-18 04:10:52,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:10:52,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:52,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653452988"}]},"ts":"1689653452988"} 2023-07-18 04:10:52,990 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 04:10:53,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:53,106 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:53,108 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:53,108 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:53,108 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:53,108 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:53,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, ASSIGN}] 2023-07-18 04:10:53,112 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, ASSIGN 2023-07-18 04:10:53,112 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, ASSIGN 2023-07-18 04:10:53,113 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40467,1689653423184; forceNewPlan=false, retain=false 2023-07-18 04:10:53,113 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:10:53,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:53,263 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:10:53,266 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=84d06c3be0f95200d530c37f98e38277, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:53,266 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0b4a2d56837f9c6363042980728d586b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:53,266 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653453266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653453266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653453266"}]},"ts":"1689653453266"} 2023-07-18 04:10:53,266 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653453266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653453266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653453266"}]},"ts":"1689653453266"} 2023-07-18 04:10:53,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 0b4a2d56837f9c6363042980728d586b, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:10:53,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 84d06c3be0f95200d530c37f98e38277, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:10:53,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:53,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b4a2d56837f9c6363042980728d586b, NAME => 'testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:10:53,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. service=AccessControlService 2023-07-18 04:10:53,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 84d06c3be0f95200d530c37f98e38277, NAME => 'testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:10:53,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. service=AccessControlService 2023-07-18 04:10:53,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,428 INFO [StoreOpener-0b4a2d56837f9c6363042980728d586b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,428 INFO [StoreOpener-84d06c3be0f95200d530c37f98e38277-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,429 DEBUG [StoreOpener-0b4a2d56837f9c6363042980728d586b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf 2023-07-18 04:10:53,429 DEBUG [StoreOpener-0b4a2d56837f9c6363042980728d586b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf 2023-07-18 04:10:53,430 DEBUG [StoreOpener-84d06c3be0f95200d530c37f98e38277-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf 2023-07-18 04:10:53,430 DEBUG [StoreOpener-84d06c3be0f95200d530c37f98e38277-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf 2023-07-18 04:10:53,430 INFO [StoreOpener-0b4a2d56837f9c6363042980728d586b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4a2d56837f9c6363042980728d586b columnFamilyName cf 2023-07-18 04:10:53,430 INFO [StoreOpener-84d06c3be0f95200d530c37f98e38277-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84d06c3be0f95200d530c37f98e38277 columnFamilyName cf 2023-07-18 04:10:53,430 INFO [StoreOpener-0b4a2d56837f9c6363042980728d586b-1] regionserver.HStore(310): Store=0b4a2d56837f9c6363042980728d586b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:53,432 INFO [StoreOpener-84d06c3be0f95200d530c37f98e38277-1] regionserver.HStore(310): Store=84d06c3be0f95200d530c37f98e38277/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:53,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:10:53,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:10:53,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:53,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:53,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 84d06c3be0f95200d530c37f98e38277; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71479971, jitterRate=0.06513457000255585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:53,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b4a2d56837f9c6363042980728d586b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70743332, jitterRate=0.054157793521881104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:53,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 84d06c3be0f95200d530c37f98e38277: 2023-07-18 04:10:53,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b4a2d56837f9c6363042980728d586b: 2023-07-18 04:10:53,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277., pid=31, masterSystemTime=1689653453422 2023-07-18 04:10:53,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b., pid=30, masterSystemTime=1689653453421 2023-07-18 04:10:53,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:53,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:53,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=84d06c3be0f95200d530c37f98e38277, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:53,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:53,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:53,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653453445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653453445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653453445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653453445"}]},"ts":"1689653453445"} 2023-07-18 04:10:53,445 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0b4a2d56837f9c6363042980728d586b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:53,446 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653453445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653453445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653453445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653453445"}]},"ts":"1689653453445"} 2023-07-18 04:10:53,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-18 04:10:53,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-18 04:10:53,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 84d06c3be0f95200d530c37f98e38277, server=jenkins-hbase4.apache.org,36369,1689653423335 in 177 msec 2023-07-18 04:10:53,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 0b4a2d56837f9c6363042980728d586b, server=jenkins-hbase4.apache.org,40467,1689653423184 in 179 msec 2023-07-18 04:10:53,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, ASSIGN in 342 msec 2023-07-18 04:10:53,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-18 04:10:53,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, ASSIGN in 345 msec 2023-07-18 04:10:53,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:53,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653453459"}]},"ts":"1689653453459"} 2023-07-18 04:10:53,460 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 04:10:53,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:53,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:53,585 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 04:10:53,587 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:53,691 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:53,691 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:53,691 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:53,691 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:53,784 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:53,784 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:53,784 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:53,784 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:53,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 840 msec 2023-07-18 04:10:54,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:54,054 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 04:10:54,054 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 04:10:54,054 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:54,059 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 04:10:54,059 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:54,059 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-18 04:10:54,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653454066 (current time:1689653454066). 2023-07-18 04:10:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x23dd94e1 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:54,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2da50749, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:54,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:54,141 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:54,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23dd94e1 to 127.0.0.1:52746 2023-07-18 04:10:54,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:54,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x32ebcb42 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:54,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dde3b62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:54,201 DEBUG [hconnection-0x7844f4df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:54,207 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:54,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:54,215 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:54,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32ebcb42 to 127.0.0.1:52746 2023-07-18 04:10:54,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:54,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:54,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:54,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:54,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:54,221 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:54,222 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654054222 2023-07-18 04:10:54,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 04:10:54,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:54,224 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:54,224 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:54,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:54,225 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:54,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 04:10:54,228 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:54,229 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654054229 2023-07-18 04:10:54,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,252 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 04:10:54,252 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:54,254 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 04:10:54,254 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:10:54,260 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,260 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,300 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,300 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,300 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,300 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,300 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,301 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,301 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:54,305 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:54,306 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,306 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,306 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:54,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,306 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:54,307 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:54,308 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:54,308 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:54,308 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:54,308 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:54,310 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:54,310 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:54,310 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:54,324 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:54,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:54,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:54,326 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:54,337 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,337 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:54,526 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:54,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:54,528 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:10:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,561 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:54,562 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,562 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,562 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:54,562 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12aa7bbc[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:54,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:54,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12aa7bbc[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:54,567 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:10:54,567 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:54,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,615 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:54,615 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,615 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:54,615 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:54,615 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:54,615 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:54,615 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:10:54,615 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:54,615 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. started... 2023-07-18 04:10:54,617 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4a2d56837f9c6363042980728d586b: 2023-07-18 04:10:54,617 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:54,617 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. started... 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:54,617 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:54,619 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 84d06c3be0f95200d530c37f98e38277: 2023-07-18 04:10:54,619 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,619 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:54,619 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:54,639 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. completed. 2023-07-18 04:10:54,639 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:54,639 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:10:54,643 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. completed. 2023-07-18 04:10:54,643 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:10:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:54,714 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,714 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:54,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:54,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:54,714 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:54,714 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:54,791 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:54,791 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:54,791 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,791 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:54,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:54,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:54,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:54,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:10:54,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:10:54,803 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 04:10:54,803 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:54,803 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:54,803 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,803 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:54,828 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:54,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:54,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:54,830 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:54,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,860 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,861 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:54,861 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,862 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:54,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,863 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:54,866 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,866 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,866 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,906 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,906 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,906 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,906 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:54,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,907 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:54,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,907 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:54,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:54,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 04:10:54,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,960 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:54,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689653454222Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689653454908 (+686 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689653454910 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689653454916 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689653454928 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689653454960 (+32 ms) 2023-07-18 04:10:54,963 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:54,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 740 msec 2023-07-18 04:10:55,330 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:55,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:55,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:55,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:55,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40467] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:55,350 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 04:10:55,350 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:55,350 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:55,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:55,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653455362 (current time:1689653455362). 2023-07-18 04:10:55,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:55,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x0c4cd9d6 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:55,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d0a89b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:55,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:55,375 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:55,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c4cd9d6 to 127.0.0.1:52746 2023-07-18 04:10:55,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:55,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x51310acc to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:55,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2adc08c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:55,387 DEBUG [hconnection-0x2a08cda6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:55,388 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:55,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:55,394 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:55,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51310acc to 127.0.0.1:52746 2023-07-18 04:10:55,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:55,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:55,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:55,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:55,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:55,401 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:55,402 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654055402 2023-07-18 04:10:55,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:55,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 04:10:55,403 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:55,403 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:55,405 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:55,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:55,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 04:10:55,408 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:55,409 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654055408 2023-07-18 04:10:55,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 04:10:55,428 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 04:10:55,428 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:55,430 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 04:10:55,430 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:10:55,431 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,431 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,432 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,432 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,433 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,433 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,433 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:55,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:55,434 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:55,434 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:55,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:55,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,435 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:55,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:55,435 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:55,435 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:55,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:55,440 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:55,442 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:55,442 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:55,442 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:55,444 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,445 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,445 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,445 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,445 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:55,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:55,445 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,445 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:55,446 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,446 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,446 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:55,446 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:55,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e58d06c[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:55,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:55,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:55,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:55,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:55,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e58d06c[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:55,450 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:10:55,450 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:55,452 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:55,452 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:55,452 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,452 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. started... 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:55,452 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:55,452 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:55,452 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:55,453 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:55,453 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. started... 2023-07-18 04:10:55,453 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:10:55,453 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b4a2d56837f9c6363042980728d586b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 04:10:55,453 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 84d06c3be0f95200d530c37f98e38277 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 04:10:55,454 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:55,454 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:55,454 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:55,479 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/.tmp/cf/018b8cdc43a64930a71bce193d303371 2023-07-18 04:10:55,492 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/.tmp/cf/018b8cdc43a64930a71bce193d303371 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371 2023-07-18 04:10:55,499 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/.tmp/cf/4011bd4d1a5a4216837fff46393bb281 2023-07-18 04:10:55,499 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 04:10:55,502 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 84d06c3be0f95200d530c37f98e38277 in 49ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:55,502 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 04:10:55,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 84d06c3be0f95200d530c37f98e38277: 2023-07-18 04:10:55,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:55,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:55,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371] hfiles 2023-07-18 04:10:55,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:55,509 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/.tmp/cf/4011bd4d1a5a4216837fff46393bb281 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281 2023-07-18 04:10:55,516 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 04:10:55,517 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0b4a2d56837f9c6363042980728d586b in 64ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:55,520 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4a2d56837f9c6363042980728d586b: 2023-07-18 04:10:55,520 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:55,520 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:55,520 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281] hfiles 2023-07-18 04:10:55,520 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:55,527 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. completed. 2023-07-18 04:10:55,531 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:10:55,531 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:10:55,537 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. completed. 2023-07-18 04:10:55,538 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:10:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:55,538 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:10:55,540 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:55,540 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,540 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:55,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:55,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:55,540 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:55,542 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,542 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:55,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:55,542 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:55,542 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:55,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:55,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:10:55,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:10:55,551 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 04:10:55,551 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:55,551 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:55,551 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 04:10:55,551 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:55,553 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,553 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,553 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,554 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:55,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,555 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:55,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,556 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,559 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,559 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:55,559 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,563 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:10:55,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:10:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 04:10:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:55,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 04:10:55,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689653455402Consolidate snapshot: snaptb0-testExportFileSystemState at 1689653455564 (+162 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689653455564Writing data manifest for snaptb0-testExportFileSystemState at 1689653455579 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689653455596 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689653455671 (+75 ms) 2023-07-18 04:10:55,675 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:55,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 272 msec 2023-07-18 04:10:55,705 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:55,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:55,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:55,707 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707 2023-07-18 04:10:55,707 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45769, tgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707, rawTgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:55,745 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:10:55,745 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1237000167_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,745 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 04:10:55,771 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:55,842 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,842 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,917 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-2156953096014796935.jar 2023-07-18 04:10:55,918 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,918 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,920 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:55,920 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:10:55,920 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:10:55,921 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:10:55,921 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:10:55,921 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:10:55,922 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:10:55,922 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:10:55,922 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:10:55,923 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:10:55,923 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:10:55,924 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:55,924 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:55,924 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:55,925 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:55,925 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:55,925 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:55,926 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:56,259 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:57,023 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:10:57,026 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 04:10:57,028 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 04:10:57,134 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:57,134 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:57,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0002_000001 (auth:SIMPLE) 2023-07-18 04:10:57,733 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:11:01,768 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:04,011 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:07,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:09,277 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:09,281 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:09,289 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 04:11:09,289 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:09,290 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:09,290 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:11:09,291 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 04:11:09,291 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 04:11:09,291 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:11:09,291 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 04:11:09,291 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653455707/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 04:11:09,298 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 04:11:09,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 04:11:09,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:09,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653469304"}]},"ts":"1689653469304"} 2023-07-18 04:11:09,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 04:11:09,309 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 04:11:09,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, UNASSIGN}] 2023-07-18 04:11:09,312 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, UNASSIGN 2023-07-18 04:11:09,312 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, UNASSIGN 2023-07-18 04:11:09,313 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0b4a2d56837f9c6363042980728d586b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:09,313 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=84d06c3be0f95200d530c37f98e38277, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:09,313 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653469313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653469313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653469313"}]},"ts":"1689653469313"} 2023-07-18 04:11:09,313 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653469313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653469313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653469313"}]},"ts":"1689653469313"} 2023-07-18 04:11:09,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 0b4a2d56837f9c6363042980728d586b, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:11:09,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 84d06c3be0f95200d530c37f98e38277, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:09,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:09,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:11:09,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b4a2d56837f9c6363042980728d586b, disabling compactions & flushes 2023-07-18 04:11:09,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:11:09,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:11:09,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. after waiting 0 ms 2023-07-18 04:11:09,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:11:09,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:11:09,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 84d06c3be0f95200d530c37f98e38277, disabling compactions & flushes 2023-07-18 04:11:09,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:11:09,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:11:09,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. after waiting 0 ms 2023-07-18 04:11:09,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:11:09,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:09,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:09,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:09,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b. 2023-07-18 04:11:09,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b4a2d56837f9c6363042980728d586b: 2023-07-18 04:11:09,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:09,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277. 2023-07-18 04:11:09,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 84d06c3be0f95200d530c37f98e38277: 2023-07-18 04:11:09,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b4a2d56837f9c6363042980728d586b 2023-07-18 04:11:09,488 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0b4a2d56837f9c6363042980728d586b, regionState=CLOSED 2023-07-18 04:11:09,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653469488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653469488"}]},"ts":"1689653469488"} 2023-07-18 04:11:09,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 84d06c3be0f95200d530c37f98e38277 2023-07-18 04:11:09,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=84d06c3be0f95200d530c37f98e38277, regionState=CLOSED 2023-07-18 04:11:09,489 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653469489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653469489"}]},"ts":"1689653469489"} 2023-07-18 04:11:09,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-18 04:11:09,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 0b4a2d56837f9c6363042980728d586b, server=jenkins-hbase4.apache.org,40467,1689653423184 in 175 msec 2023-07-18 04:11:09,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-18 04:11:09,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 84d06c3be0f95200d530c37f98e38277, server=jenkins-hbase4.apache.org,36369,1689653423335 in 175 msec 2023-07-18 04:11:09,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0b4a2d56837f9c6363042980728d586b, UNASSIGN in 182 msec 2023-07-18 04:11:09,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-18 04:11:09,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=84d06c3be0f95200d530c37f98e38277, UNASSIGN in 183 msec 2023-07-18 04:11:09,495 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653469495"}]},"ts":"1689653469495"} 2023-07-18 04:11:09,496 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 04:11:09,498 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 04:11:09,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-18 04:11:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:09,606 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 04:11:09,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 04:11:09,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 04:11:09,613 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,614 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 04:11:09,616 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,616 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,616 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,617 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,617 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:09,617 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:09,617 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:09,618 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:11:09,618 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:11:09,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:09,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:09,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-18 04:11:09,619 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:09,619 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:11:09,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 04:11:09,621 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/recovered.edits] 2023-07-18 04:11:09,622 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/recovered.edits] 2023-07-18 04:11:09,622 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:09,622 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:09,627 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/cf/4011bd4d1a5a4216837fff46393bb281 2023-07-18 04:11:09,627 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/cf/018b8cdc43a64930a71bce193d303371 2023-07-18 04:11:09,632 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b/recovered.edits/9.seqid 2023-07-18 04:11:09,633 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277/recovered.edits/9.seqid 2023-07-18 04:11:09,633 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/0b4a2d56837f9c6363042980728d586b 2023-07-18 04:11:09,635 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemState/84d06c3be0f95200d530c37f98e38277 2023-07-18 04:11:09,635 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 04:11:09,638 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,641 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 04:11:09,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 04:11:09,644 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,644 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 04:11:09,644 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653469644"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:09,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653469644"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:09,647 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:11:09,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 84d06c3be0f95200d530c37f98e38277, NAME => 'testtb-testExportFileSystemState,,1689653452942.84d06c3be0f95200d530c37f98e38277.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0b4a2d56837f9c6363042980728d586b, NAME => 'testtb-testExportFileSystemState,1,1689653452942.0b4a2d56837f9c6363042980728d586b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:11:09,647 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 04:11:09,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653469647"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:09,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 04:11:09,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:09,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-07-18 04:11:09,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 04:11:09,722 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 04:11:09,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 04:11:09,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 04:11:09,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 04:11:09,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 04:11:09,760 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:42318 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-310458406_1 at /127.0.0.1:37868 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-310458406_1 at /127.0.0.1:50580 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:50606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:37888 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:41189 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-2067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=933 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2765 (was 3013) 2023-07-18 04:11:09,760 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-18 04:11:09,779 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=343, ProcessCount=181, AvailableMemoryMB=2764 2023-07-18 04:11:09,780 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-18 04:11:09,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:11:09,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:09,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:09,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 04:11:09,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:09,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:09,788 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:09,788 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:09,789 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 empty. 2023-07-18 04:11:09,789 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a empty. 2023-07-18 04:11:09,789 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:09,790 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:09,790 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 04:11:09,803 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:09,804 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e3029e95fa069d27dd1a1459029d364, NAME => 'testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:09,804 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7a15ca10955a7faefba6e53b70c5609a, NAME => 'testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7a15ca10955a7faefba6e53b70c5609a, disabling compactions & flushes 2023-07-18 04:11:09,820 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. after waiting 0 ms 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:09,820 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:09,820 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7a15ca10955a7faefba6e53b70c5609a: 2023-07-18 04:11:09,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:09,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0e3029e95fa069d27dd1a1459029d364, disabling compactions & flushes 2023-07-18 04:11:09,823 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:09,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:09,824 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. after waiting 0 ms 2023-07-18 04:11:09,824 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:09,824 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:09,824 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0e3029e95fa069d27dd1a1459029d364: 2023-07-18 04:11:09,826 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:09,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653469827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653469827"}]},"ts":"1689653469827"} 2023-07-18 04:11:09,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653469827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653469827"}]},"ts":"1689653469827"} 2023-07-18 04:11:09,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:09,831 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:09,831 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653469831"}]},"ts":"1689653469831"} 2023-07-18 04:11:09,833 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 04:11:09,837 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:09,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:09,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:09,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:09,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:09,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, ASSIGN}] 2023-07-18 04:11:09,841 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, ASSIGN 2023-07-18 04:11:09,841 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, ASSIGN 2023-07-18 04:11:09,842 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:11:09,842 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:11:09,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:09,992 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:09,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7a15ca10955a7faefba6e53b70c5609a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:09,995 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e3029e95fa069d27dd1a1459029d364, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:09,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653469995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653469995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653469995"}]},"ts":"1689653469995"} 2023-07-18 04:11:09,995 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653469995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653469995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653469995"}]},"ts":"1689653469995"} 2023-07-18 04:11:09,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 7a15ca10955a7faefba6e53b70c5609a, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:09,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 0e3029e95fa069d27dd1a1459029d364, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:10,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:10,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e3029e95fa069d27dd1a1459029d364, NAME => 'testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a15ca10955a7faefba6e53b70c5609a, NAME => 'testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. service=AccessControlService 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. service=AccessControlService 2023-07-18 04:11:10,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:10,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,161 INFO [StoreOpener-7a15ca10955a7faefba6e53b70c5609a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,161 INFO [StoreOpener-0e3029e95fa069d27dd1a1459029d364-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,163 DEBUG [StoreOpener-0e3029e95fa069d27dd1a1459029d364-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf 2023-07-18 04:11:10,163 DEBUG [StoreOpener-0e3029e95fa069d27dd1a1459029d364-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf 2023-07-18 04:11:10,163 DEBUG [StoreOpener-7a15ca10955a7faefba6e53b70c5609a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf 2023-07-18 04:11:10,163 DEBUG [StoreOpener-7a15ca10955a7faefba6e53b70c5609a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf 2023-07-18 04:11:10,163 INFO [StoreOpener-7a15ca10955a7faefba6e53b70c5609a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a15ca10955a7faefba6e53b70c5609a columnFamilyName cf 2023-07-18 04:11:10,163 INFO [StoreOpener-0e3029e95fa069d27dd1a1459029d364-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e3029e95fa069d27dd1a1459029d364 columnFamilyName cf 2023-07-18 04:11:10,164 INFO [StoreOpener-7a15ca10955a7faefba6e53b70c5609a-1] regionserver.HStore(310): Store=7a15ca10955a7faefba6e53b70c5609a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:10,164 INFO [StoreOpener-0e3029e95fa069d27dd1a1459029d364-1] regionserver.HStore(310): Store=0e3029e95fa069d27dd1a1459029d364/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:10,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:10,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:10,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:10,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:10,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e3029e95fa069d27dd1a1459029d364; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67798874, jitterRate=0.010281950235366821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:10,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e3029e95fa069d27dd1a1459029d364: 2023-07-18 04:11:10,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a15ca10955a7faefba6e53b70c5609a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74827934, jitterRate=0.11502310633659363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:10,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a15ca10955a7faefba6e53b70c5609a: 2023-07-18 04:11:10,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364., pid=46, masterSystemTime=1689653470153 2023-07-18 04:11:10,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a., pid=45, masterSystemTime=1689653470152 2023-07-18 04:11:10,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e3029e95fa069d27dd1a1459029d364, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653470176"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653470176"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653470176"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653470176"}]},"ts":"1689653470176"} 2023-07-18 04:11:10,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,177 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7a15ca10955a7faefba6e53b70c5609a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,178 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653470177"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653470177"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653470177"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653470177"}]},"ts":"1689653470177"} 2023-07-18 04:11:10,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-18 04:11:10,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 0e3029e95fa069d27dd1a1459029d364, server=jenkins-hbase4.apache.org,36369,1689653423335 in 180 msec 2023-07-18 04:11:10,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-18 04:11:10,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 7a15ca10955a7faefba6e53b70c5609a, server=jenkins-hbase4.apache.org,34797,1689653423262 in 182 msec 2023-07-18 04:11:10,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, ASSIGN in 344 msec 2023-07-18 04:11:10,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 04:11:10,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, ASSIGN in 345 msec 2023-07-18 04:11:10,186 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:10,186 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653470186"}]},"ts":"1689653470186"} 2023-07-18 04:11:10,188 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 04:11:10,192 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:10,193 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 04:11:10,195 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:10,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:10,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:10,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:10,196 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:10,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:10,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:10,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:10,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:10,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 419 msec 2023-07-18 04:11:10,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:10,390 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 04:11:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-18 04:11:10,391 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:10,394 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-18 04:11:10,394 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:10,394 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-18 04:11:10,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653470397 (current time:1689653470397). 2023-07-18 04:11:10,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:10,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x12ca3298 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:10,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25fb51a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:10,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,408 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12ca3298 to 127.0.0.1:52746 2023-07-18 04:11:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:10,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x60ead193 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:10,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@237761e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:10,415 DEBUG [hconnection-0x5cfe0a3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,418 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,423 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ead193 to 127.0.0.1:52746 2023-07-18 04:11:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,431 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,432 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689654070432 2023-07-18 04:11:10,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 04:11:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:10,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:10,435 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-18 04:11:10,438 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:10,438 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689654070438 2023-07-18 04:11:10,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,450 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 04:11:10,450 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,451 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 04:11:10,451 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 04:11:10,451 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,451 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,452 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,453 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,452 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,453 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,453 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,453 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,454 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,454 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,454 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,454 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,456 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,459 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,460 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,461 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,461 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,467 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,467 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,467 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51655a32[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:10,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51655a32[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:10,477 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 04:11:10,478 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:10,479 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:11:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:10,480 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,480 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,480 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:10,480 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. started... 2023-07-18 04:11:10,480 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. started... 2023-07-18 04:11:10,480 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e3029e95fa069d27dd1a1459029d364: 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a15ca10955a7faefba6e53b70c5609a: 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:10,482 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:10,486 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:10,486 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,486 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:10,503 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. completed. 2023-07-18 04:11:10,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. completed. 2023-07-18 04:11:10,503 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,503 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:11:10,504 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:11:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:10,505 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:10,505 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,506 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,506 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:10,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:11:10,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 04:11:10,515 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 04:11:10,515 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:10,515 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:10,515 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,515 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,517 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,518 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,518 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,519 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,521 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,521 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,521 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,525 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,526 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,527 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,525 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,527 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,527 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,527 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:10,528 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:10,528 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,528 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,528 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,528 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,534 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:10,536 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:10,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 04:11:10,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,574 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:10,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689653470433Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689653470527 (+94 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689653470527Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689653470531 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689653470546 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689653470573 (+27 ms) 2023-07-18 04:11:10,580 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:10,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 147 msec 2023-07-18 04:11:10,736 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:10,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:10,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:10,744 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:10,750 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:10,755 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 04:11:10,755 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,756 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:10,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653470768 (current time:1689653470768). 2023-07-18 04:11:10,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:10,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x69d90738 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:10,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e5c3f6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:10,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,784 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69d90738 to 127.0.0.1:52746 2023-07-18 04:11:10,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:10,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x69820630 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:10,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48433cff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:10,803 DEBUG [hconnection-0x77dbd5cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,806 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:10,811 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69820630 to 127.0.0.1:52746 2023-07-18 04:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,818 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,818 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689654070818 2023-07-18 04:11:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:10,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 04:11:10,820 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:10,820 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:10,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:10,822 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:10,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-18 04:11:10,824 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:10,825 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689654070825 2023-07-18 04:11:10,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 04:11:10,836 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 04:11:10,836 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,837 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 04:11:10,837 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 04:11:10,838 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,838 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,839 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,839 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,839 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,839 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:10,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,840 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:10,841 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,841 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,841 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,841 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:10,844 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,843 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,845 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:10,846 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,846 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,848 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,848 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:10,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ac3d392[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:10,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ac3d392[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:10,853 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 04:11:10,853 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:10,854 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:10,855 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:10,855 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,855 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:10,856 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:10,856 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. started... 2023-07-18 04:11:10,855 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. started... 2023-07-18 04:11:10,856 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e3029e95fa069d27dd1a1459029d364 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 04:11:10,856 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a15ca10955a7faefba6e53b70c5609a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 04:11:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,857 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:10,879 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/.tmp/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 2023-07-18 04:11:10,882 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/.tmp/cf/856fdfb7b1044b118210ab5e008be42c 2023-07-18 04:11:10,886 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/.tmp/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 2023-07-18 04:11:10,895 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/.tmp/cf/856fdfb7b1044b118210ab5e008be42c as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c 2023-07-18 04:11:10,899 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9, entries=2, sequenceid=6, filesize=5.0 K 2023-07-18 04:11:10,900 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 0e3029e95fa069d27dd1a1459029d364 in 44ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:10,900 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 04:11:10,901 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e3029e95fa069d27dd1a1459029d364: 2023-07-18 04:11:10,901 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c, entries=48, sequenceid=6, filesize=8.1 K 2023-07-18 04:11:10,901 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:10,901 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:10,901 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9] hfiles 2023-07-18 04:11:10,901 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:10,902 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 7a15ca10955a7faefba6e53b70c5609a in 46ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:10,904 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a15ca10955a7faefba6e53b70c5609a: 2023-07-18 04:11:10,904 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:10,904 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:10,904 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c] hfiles 2023-07-18 04:11:10,904 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:10,916 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. completed. 2023-07-18 04:11:10,916 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:10,916 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:10,916 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:10,916 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,916 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:10,916 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:11:10,918 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:10,918 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,918 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:10,918 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:10,920 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:10,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:10,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:10,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:10,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:10,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:10,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,922 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:10,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:10,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:10,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:10,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:10,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:10,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:11:10,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 04:11:11,122 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:11,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:11,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:11,124 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:11,317 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. completed. 2023-07-18 04:11:11,317 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:11,317 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:11:11,320 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:11,320 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:11:11,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 04:11:11,325 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 04:11:11,325 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:11,325 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:11,325 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 04:11:11,325 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:11,327 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,327 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,327 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:11,328 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,328 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,328 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,328 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,329 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:11,331 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,331 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,331 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:11,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:11,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,338 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:11,338 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 04:11:11,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,340 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:11,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 04:11:11,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,382 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689653470819Consolidate snapshot: snaptb0-testConsecutiveExports at 1689653471338 (+519 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689653471340 (+2 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689653471344 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689653471354 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689653471381 (+27 ms) 2023-07-18 04:11:11,384 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:11,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 564 msec 2023-07-18 04:11:11,424 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:11,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:11,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:11,425 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425 2023-07-18 04:11:11,425 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:11,450 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:11,450 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6e0a5f59, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,450 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 04:11:11,458 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:11,471 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,472 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,472 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,472 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,473 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,473 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,474 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,551 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-4274897145857714534.jar 2023-07-18 04:11:11,552 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,552 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,553 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,553 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,554 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,554 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:11,555 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:11,556 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:11,556 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:11,557 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:11,557 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:11,558 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:11,558 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:11,559 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:11,559 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:11,560 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:11,561 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:11,561 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:11,562 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:11,563 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:11,563 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:11,564 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:11,564 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:12,454 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:12,457 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 04:11:12,459 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 04:11:13,480 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:13,480 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:13,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:14,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:15,098 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:11:18,705 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:20,964 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:23,391 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:24,686 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:24,686 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:24,690 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 04:11:24,690 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:24,691 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:24,691 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:24,693 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:24,693 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:24,693 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@10328e3 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:24,693 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:24,693 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:24,695 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@285c8ed4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:24,720 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 04:11:24,732 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:24,744 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,744 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,745 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,745 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,745 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,746 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,746 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,814 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-4692123523212215365.jar 2023-07-18 04:11:24,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,816 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,816 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,816 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:24,817 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:24,817 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:24,817 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:24,818 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:24,818 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:24,818 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:24,819 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:24,819 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:24,819 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:24,820 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:24,821 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:24,821 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:24,821 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:24,821 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:24,822 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:24,822 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:25,198 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:25,201 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 04:11:25,203 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 04:11:29,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:29,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:29,595 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:30,495 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:34,634 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:36,941 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:39,490 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:39,509 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689653432320_0004_01_000002 is : 143 2023-07-18 04:11:41,409 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:41,409 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:41,412 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 04:11:41,412 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:41,413 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:41,413 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@10328e3 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/local-export-1689653471425/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:41,437 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 04:11:41,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 04:11:41,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:41,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653501446"}]},"ts":"1689653501446"} 2023-07-18 04:11:41,448 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 04:11:41,450 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 04:11:41,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, UNASSIGN}] 2023-07-18 04:11:41,454 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, UNASSIGN 2023-07-18 04:11:41,454 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, UNASSIGN 2023-07-18 04:11:41,461 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0e3029e95fa069d27dd1a1459029d364, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:41,461 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653501461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653501461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653501461"}]},"ts":"1689653501461"} 2023-07-18 04:11:41,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 0e3029e95fa069d27dd1a1459029d364, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:41,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7a15ca10955a7faefba6e53b70c5609a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:41,467 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653501467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653501467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653501467"}]},"ts":"1689653501467"} 2023-07-18 04:11:41,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 7a15ca10955a7faefba6e53b70c5609a, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:41,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:41,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e3029e95fa069d27dd1a1459029d364, disabling compactions & flushes 2023-07-18 04:11:41,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. after waiting 0 ms 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:41,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a15ca10955a7faefba6e53b70c5609a, disabling compactions & flushes 2023-07-18 04:11:41,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:41,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. after waiting 0 ms 2023-07-18 04:11:41,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:41,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:41,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364. 2023-07-18 04:11:41,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e3029e95fa069d27dd1a1459029d364: 2023-07-18 04:11:41,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a. 2023-07-18 04:11:41,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a15ca10955a7faefba6e53b70c5609a: 2023-07-18 04:11:41,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:41,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0e3029e95fa069d27dd1a1459029d364, regionState=CLOSED 2023-07-18 04:11:41,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653501646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653501646"}]},"ts":"1689653501646"} 2023-07-18 04:11:41,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:41,647 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7a15ca10955a7faefba6e53b70c5609a, regionState=CLOSED 2023-07-18 04:11:41,648 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653501647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653501647"}]},"ts":"1689653501647"} 2023-07-18 04:11:41,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-18 04:11:41,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-18 04:11:41,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 7a15ca10955a7faefba6e53b70c5609a, server=jenkins-hbase4.apache.org,34797,1689653423262 in 181 msec 2023-07-18 04:11:41,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 0e3029e95fa069d27dd1a1459029d364, server=jenkins-hbase4.apache.org,36369,1689653423335 in 186 msec 2023-07-18 04:11:41,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e3029e95fa069d27dd1a1459029d364, UNASSIGN in 210 msec 2023-07-18 04:11:41,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-18 04:11:41,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a15ca10955a7faefba6e53b70c5609a, UNASSIGN in 210 msec 2023-07-18 04:11:41,667 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653501667"}]},"ts":"1689653501667"} 2023-07-18 04:11:41,668 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 04:11:41,671 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 04:11:41,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 234 msec 2023-07-18 04:11:41,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:41,749 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 04:11:41,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 04:11:41,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 04:11:41,759 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,762 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 04:11:41,765 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,765 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,765 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,765 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:41,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:41,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:41,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:41,767 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,767 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:41,767 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,767 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:41,767 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,768 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:41,768 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:41,768 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:41,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 04:11:41,772 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:41,775 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/recovered.edits] 2023-07-18 04:11:41,778 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:41,783 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/recovered.edits] 2023-07-18 04:11:41,789 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/cf/856fdfb7b1044b118210ab5e008be42c 2023-07-18 04:11:41,794 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/cf/fdf7e00fe6bd4e38a2968600a96f7ba9 2023-07-18 04:11:41,796 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a/recovered.edits/9.seqid 2023-07-18 04:11:41,796 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/7a15ca10955a7faefba6e53b70c5609a 2023-07-18 04:11:41,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364/recovered.edits/9.seqid 2023-07-18 04:11:41,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testConsecutiveExports/0e3029e95fa069d27dd1a1459029d364 2023-07-18 04:11:41,799 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 04:11:41,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,805 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 04:11:41,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 04:11:41,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 04:11:41,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653501815"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:41,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653501815"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:41,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:11:41,821 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0e3029e95fa069d27dd1a1459029d364, NAME => 'testtb-testConsecutiveExports,,1689653469781.0e3029e95fa069d27dd1a1459029d364.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7a15ca10955a7faefba6e53b70c5609a, NAME => 'testtb-testConsecutiveExports,1,1689653469781.7a15ca10955a7faefba6e53b70c5609a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:11:41,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 04:11:41,821 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653501821"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:41,823 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 04:11:41,827 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:41,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 76 msec 2023-07-18 04:11:41,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 04:11:41,871 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 04:11:41,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 04:11:41,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:41,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 04:11:41,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 04:11:41,951 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=751 (was 765), OpenFileDescriptor=903 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 343) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3072 (was 2764) - AvailableMemoryMB LEAK? - 2023-07-18 04:11:41,951 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-18 04:11:41,975 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=183, AvailableMemoryMB=3070 2023-07-18 04:11:41,975 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-18 04:11:41,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:11:41,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:41,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 04:11:41,982 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:41,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:41,985 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:41,985 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:41,986 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 empty. 2023-07-18 04:11:41,986 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b empty. 2023-07-18 04:11:41,987 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:41,987 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:41,987 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 04:11:42,015 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:42,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 02bc6fba1ae9b0624bcbf438ef8d538b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:42,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0151713b14e1ca20abff8f747121d2d0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:42,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0151713b14e1ca20abff8f747121d2d0, disabling compactions & flushes 2023-07-18 04:11:42,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. after waiting 0 ms 2023-07-18 04:11:42,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0151713b14e1ca20abff8f747121d2d0: 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 02bc6fba1ae9b0624bcbf438ef8d538b, disabling compactions & flushes 2023-07-18 04:11:42,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. after waiting 0 ms 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 02bc6fba1ae9b0624bcbf438ef8d538b: 2023-07-18 04:11:42,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:42,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653502149"}]},"ts":"1689653502149"} 2023-07-18 04:11:42,150 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653502149"}]},"ts":"1689653502149"} 2023-07-18 04:11:42,160 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:42,161 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:42,162 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653502161"}]},"ts":"1689653502161"} 2023-07-18 04:11:42,163 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 04:11:42,167 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:42,187 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:42,187 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:42,187 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:42,187 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:42,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, ASSIGN}] 2023-07-18 04:11:42,196 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, ASSIGN 2023-07-18 04:11:42,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, ASSIGN 2023-07-18 04:11:42,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:11:42,200 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:11:42,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:42,352 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:42,355 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02bc6fba1ae9b0624bcbf438ef8d538b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,356 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0151713b14e1ca20abff8f747121d2d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,356 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653502355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653502355"}]},"ts":"1689653502355"} 2023-07-18 04:11:42,356 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653502355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653502355"}]},"ts":"1689653502355"} 2023-07-18 04:11:42,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 02bc6fba1ae9b0624bcbf438ef8d538b, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:42,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 0151713b14e1ca20abff8f747121d2d0, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:42,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02bc6fba1ae9b0624bcbf438ef8d538b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:11:42,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. service=AccessControlService 2023-07-18 04:11:42,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:42,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,518 INFO [StoreOpener-02bc6fba1ae9b0624bcbf438ef8d538b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0151713b14e1ca20abff8f747121d2d0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:11:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. service=AccessControlService 2023-07-18 04:11:42,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,520 DEBUG [StoreOpener-02bc6fba1ae9b0624bcbf438ef8d538b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf 2023-07-18 04:11:42,520 DEBUG [StoreOpener-02bc6fba1ae9b0624bcbf438ef8d538b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf 2023-07-18 04:11:42,521 INFO [StoreOpener-0151713b14e1ca20abff8f747121d2d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,522 INFO [StoreOpener-02bc6fba1ae9b0624bcbf438ef8d538b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02bc6fba1ae9b0624bcbf438ef8d538b columnFamilyName cf 2023-07-18 04:11:42,523 INFO [StoreOpener-02bc6fba1ae9b0624bcbf438ef8d538b-1] regionserver.HStore(310): Store=02bc6fba1ae9b0624bcbf438ef8d538b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:42,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,526 DEBUG [StoreOpener-0151713b14e1ca20abff8f747121d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf 2023-07-18 04:11:42,526 DEBUG [StoreOpener-0151713b14e1ca20abff8f747121d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf 2023-07-18 04:11:42,527 INFO [StoreOpener-0151713b14e1ca20abff8f747121d2d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0151713b14e1ca20abff8f747121d2d0 columnFamilyName cf 2023-07-18 04:11:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:11:42,527 INFO [StoreOpener-0151713b14e1ca20abff8f747121d2d0-1] regionserver.HStore(310): Store=0151713b14e1ca20abff8f747121d2d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:42,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:42,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02bc6fba1ae9b0624bcbf438ef8d538b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65213368, jitterRate=-0.028245091438293457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:42,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02bc6fba1ae9b0624bcbf438ef8d538b: 2023-07-18 04:11:42,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:11:42,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b., pid=60, masterSystemTime=1689653502512 2023-07-18 04:11:42,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:42,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0151713b14e1ca20abff8f747121d2d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67619081, jitterRate=0.00760282576084137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:42,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0151713b14e1ca20abff8f747121d2d0: 2023-07-18 04:11:42,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0., pid=61, masterSystemTime=1689653502516 2023-07-18 04:11:42,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,540 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02bc6fba1ae9b0624bcbf438ef8d538b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,540 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653502540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653502540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653502540"}]},"ts":"1689653502540"} 2023-07-18 04:11:42,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,542 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0151713b14e1ca20abff8f747121d2d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,542 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653502541"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653502541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653502541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653502541"}]},"ts":"1689653502541"} 2023-07-18 04:11:42,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 04:11:42,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 02bc6fba1ae9b0624bcbf438ef8d538b, server=jenkins-hbase4.apache.org,36369,1689653423335 in 184 msec 2023-07-18 04:11:42,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 04:11:42,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 0151713b14e1ca20abff8f747121d2d0, server=jenkins-hbase4.apache.org,34797,1689653423262 in 183 msec 2023-07-18 04:11:42,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, ASSIGN in 360 msec 2023-07-18 04:11:42,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-18 04:11:42,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, ASSIGN in 361 msec 2023-07-18 04:11:42,551 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:42,551 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653502551"}]},"ts":"1689653502551"} 2023-07-18 04:11:42,552 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 04:11:42,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:42,555 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 04:11:42,557 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:42,558 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:42,558 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:42,558 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:42,559 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:42,562 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:42,562 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:42,562 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:42,562 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:42,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 585 msec 2023-07-18 04:11:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:42,587 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 04:11:42,588 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-18 04:11:42,588 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:42,592 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-18 04:11:42,592 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:42,592 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-18 04:11:42,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:42,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653502596 (current time:1689653502596). 2023-07-18 04:11:42,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:42,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x60ed878d to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:42,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e0861b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:42,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:42,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:42,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ed878d to 127.0.0.1:52746 2023-07-18 04:11:42,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x042ecde7 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8f3f300, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:42,726 DEBUG [hconnection-0x45bb0e54-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:42,727 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:42,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:42,740 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x042ecde7 to 127.0.0.1:52746 2023-07-18 04:11:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:42,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:42,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:42,757 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:42,758 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689654102758 2023-07-18 04:11:42,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:42,761 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:42,761 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:42,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:42,773 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:42,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 19 msec 2023-07-18 04:11:42,781 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:42,782 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689654102782 2023-07-18 04:11:42,861 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:42,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:42,865 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:42,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,891 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:42,891 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:42,891 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 04:11:42,891 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 04:11:42,891 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,892 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,893 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,893 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,893 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,893 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,894 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,894 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,894 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,894 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:42,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:42,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,899 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:42,899 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:42,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:42,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:42,913 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:42,915 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:42,915 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:42,915 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:42,917 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,917 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,918 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf52eed[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:42,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf52eed[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:42,929 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 04:11:42,929 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:42,935 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,935 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:42,935 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:42,935 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:11:42,938 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:42,939 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:42,939 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,939 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. started... 2023-07-18 04:11:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:42,946 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:42,946 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0151713b14e1ca20abff8f747121d2d0: 2023-07-18 04:11:42,946 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,946 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:42,946 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:42,946 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,947 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. started... 2023-07-18 04:11:42,948 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02bc6fba1ae9b0624bcbf438ef8d538b: 2023-07-18 04:11:42,949 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,949 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:42,949 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:42,978 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. completed. 2023-07-18 04:11:42,978 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:11:42,979 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. completed. 2023-07-18 04:11:42,979 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:42,979 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:42,979 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:42,979 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,979 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:42,979 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:11:42,982 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,982 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,983 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,983 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,985 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,985 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,985 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,985 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:11:42,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 04:11:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:11:43,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 04:11:43,001 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 04:11:43,001 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:43,001 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:43,001 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,001 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,003 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:43,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:43,006 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,006 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,007 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,018 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,018 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,019 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,023 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:43,023 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,023 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:43,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:43,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:43,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:43,023 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:43,024 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:43,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:43,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:43,023 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:43,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:43,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:43,027 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:43,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,027 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,065 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:43,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:43,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:43,068 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:43,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,369 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:43,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:43,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:43,370 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:11:43,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 04:11:43,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,523 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689653502758Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653503027 (+269 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653503027Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653503050 (+23 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653503079 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689653503522 (+443 ms) 2023-07-18 04:11:43,526 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:43,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 766 msec 2023-07-18 04:11:43,837 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:43,870 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:43,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:43,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:43,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:43,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:43,889 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,889 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:43,892 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:43,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:43,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653503908 (current time:1689653503908). 2023-07-18 04:11:43,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:43,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x6792e0bc to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:43,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351c4285, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:43,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:43,933 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:43,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6792e0bc to 127.0.0.1:52746 2023-07-18 04:11:43,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:43,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x46393659 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:43,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@365ea922, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:43,947 DEBUG [hconnection-0x6181dd06-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:43,950 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:43,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:43,957 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:43,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46393659 to 127.0.0.1:52746 2023-07-18 04:11:43,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:43,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:43,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:43,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:43,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:43,970 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:43,972 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689654103972 2023-07-18 04:11:43,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:43,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:43,974 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:43,975 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:43,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:43,976 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:43,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-18 04:11:43,979 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:43,983 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689654103983 2023-07-18 04:11:44,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,065 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:44,065 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,067 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 04:11:44,067 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 04:11:44,069 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,069 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,070 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,070 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,071 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,070 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,073 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,073 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,073 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,074 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,074 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:44,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:44,075 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,075 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:44,075 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,075 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:44,077 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,077 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:44,077 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:44,077 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:44,079 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,080 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:44,080 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:44,080 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:44,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:44,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:44,084 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:44,085 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,085 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,085 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,086 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:44,087 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:44,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13765c4f[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:44,093 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,095 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,096 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,096 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,096 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:44,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13765c4f[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:44,102 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 04:11:44,102 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,103 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,103 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:44,104 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:44,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:11:44,105 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,106 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:44,106 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:44,107 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:44,106 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,107 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:44,107 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. started... 2023-07-18 04:11:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:44,107 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02bc6fba1ae9b0624bcbf438ef8d538b 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-18 04:11:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,107 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:44,110 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:44,119 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:44,120 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:44,120 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. started... 2023-07-18 04:11:44,120 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0151713b14e1ca20abff8f747121d2d0 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-18 04:11:44,180 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/.tmp/cf/1c97ad24d4ce4a6eac974aef22d7d101 2023-07-18 04:11:44,182 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/.tmp/cf/09132cc7407d47ba9ed541ec8905bdbb 2023-07-18 04:11:44,193 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/.tmp/cf/1c97ad24d4ce4a6eac974aef22d7d101 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101 2023-07-18 04:11:44,198 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/.tmp/cf/09132cc7407d47ba9ed541ec8905bdbb as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb 2023-07-18 04:11:44,201 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101, entries=49, sequenceid=6, filesize=8.1 K 2023-07-18 04:11:44,202 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 02bc6fba1ae9b0624bcbf438ef8d538b in 95ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:44,204 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02bc6fba1ae9b0624bcbf438ef8d538b: 2023-07-18 04:11:44,210 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,210 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:44,210 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101] hfiles 2023-07-18 04:11:44,210 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,220 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb, entries=1, sequenceid=6, filesize=4.9 K 2023-07-18 04:11:44,221 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 0151713b14e1ca20abff8f747121d2d0 in 101ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:44,221 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0151713b14e1ca20abff8f747121d2d0: 2023-07-18 04:11:44,222 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,222 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:44,222 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb] hfiles 2023-07-18 04:11:44,222 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,264 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. completed. 2023-07-18 04:11:44,264 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:11:44,264 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:44,264 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:44,264 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,266 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:44,267 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:11:44,269 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. completed. 2023-07-18 04:11:44,269 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:11:44,269 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:44,269 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:44,269 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,269 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,270 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,269 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,270 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,272 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:44,272 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:11:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,280 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:44,280 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,280 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,280 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:44,284 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:44,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:44,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:44,286 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:11:44,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 04:11:44,309 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 04:11:44,309 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:44,309 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:44,309 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,309 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:44,314 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,314 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,314 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,314 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,315 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,315 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,315 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,316 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,317 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,319 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,320 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,320 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,323 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,323 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,323 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,324 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,324 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 04:11:44,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,437 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:44,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689653503972Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689653504325 (+353 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689653504327 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689653504338 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689653504359 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689653504435 (+76 ms) 2023-07-18 04:11:44,441 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:44,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 467 msec 2023-07-18 04:11:44,586 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:44,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:44,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:44,628 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:44,632 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:44,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:44,634 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:44,638 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:44,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:44,639 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:44,645 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:44,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40467] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:44,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:11:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,659 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:44,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 04:11:44,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:44,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:44,663 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:44,667 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:44,668 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 empty. 2023-07-18 04:11:44,668 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 empty. 2023-07-18 04:11:44,669 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:44,669 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:44,669 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 04:11:44,696 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:44,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => af5072fc516288d1e1abb9ae0a215ce5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:44,701 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 30406878d4404e65db3f7156286fbb94, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing af5072fc516288d1e1abb9ae0a215ce5, disabling compactions & flushes 2023-07-18 04:11:44,750 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. after waiting 0 ms 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:44,750 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:44,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for af5072fc516288d1e1abb9ae0a215ce5: 2023-07-18 04:11:44,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:44,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 30406878d4404e65db3f7156286fbb94, disabling compactions & flushes 2023-07-18 04:11:44,752 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:44,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:44,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. after waiting 0 ms 2023-07-18 04:11:44,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:44,752 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:44,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 30406878d4404e65db3f7156286fbb94: 2023-07-18 04:11:44,755 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:44,756 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653504756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653504756"}]},"ts":"1689653504756"} 2023-07-18 04:11:44,756 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653504756"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653504756"}]},"ts":"1689653504756"} 2023-07-18 04:11:44,759 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:44,760 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:44,760 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653504760"}]},"ts":"1689653504760"} 2023-07-18 04:11:44,761 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 04:11:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:44,765 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:44,767 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:44,767 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:44,767 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:44,767 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:44,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, ASSIGN}] 2023-07-18 04:11:44,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, ASSIGN 2023-07-18 04:11:44,770 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, ASSIGN 2023-07-18 04:11:44,771 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:11:44,772 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:11:44,921 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:44,924 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=30406878d4404e65db3f7156286fbb94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:44,924 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=af5072fc516288d1e1abb9ae0a215ce5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:44,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653504924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653504924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653504924"}]},"ts":"1689653504924"} 2023-07-18 04:11:44,924 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653504924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653504924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653504924"}]},"ts":"1689653504924"} 2023-07-18 04:11:44,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 30406878d4404e65db3f7156286fbb94, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:44,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure af5072fc516288d1e1abb9ae0a215ce5, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:44,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:45,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30406878d4404e65db3f7156286fbb94, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 04:11:45,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af5072fc516288d1e1abb9ae0a215ce5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 04:11:45,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. service=AccessControlService 2023-07-18 04:11:45,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:45,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:45,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. service=AccessControlService 2023-07-18 04:11:45,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:45,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:45,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,086 INFO [StoreOpener-30406878d4404e65db3f7156286fbb94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,089 DEBUG [StoreOpener-30406878d4404e65db3f7156286fbb94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf 2023-07-18 04:11:45,089 DEBUG [StoreOpener-30406878d4404e65db3f7156286fbb94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf 2023-07-18 04:11:45,089 INFO [StoreOpener-af5072fc516288d1e1abb9ae0a215ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,090 INFO [StoreOpener-30406878d4404e65db3f7156286fbb94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30406878d4404e65db3f7156286fbb94 columnFamilyName cf 2023-07-18 04:11:45,090 INFO [StoreOpener-30406878d4404e65db3f7156286fbb94-1] regionserver.HStore(310): Store=30406878d4404e65db3f7156286fbb94/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:45,091 DEBUG [StoreOpener-af5072fc516288d1e1abb9ae0a215ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf 2023-07-18 04:11:45,091 DEBUG [StoreOpener-af5072fc516288d1e1abb9ae0a215ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf 2023-07-18 04:11:45,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,092 INFO [StoreOpener-af5072fc516288d1e1abb9ae0a215ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af5072fc516288d1e1abb9ae0a215ce5 columnFamilyName cf 2023-07-18 04:11:45,093 INFO [StoreOpener-af5072fc516288d1e1abb9ae0a215ce5-1] regionserver.HStore(310): Store=af5072fc516288d1e1abb9ae0a215ce5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:45,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:45,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30406878d4404e65db3f7156286fbb94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65085491, jitterRate=-0.030150607228279114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:45,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30406878d4404e65db3f7156286fbb94: 2023-07-18 04:11:45,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94., pid=69, masterSystemTime=1689653505078 2023-07-18 04:11:45,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=30406878d4404e65db3f7156286fbb94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:45,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653505108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653505108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653505108"}]},"ts":"1689653505108"} 2023-07-18 04:11:45,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:45,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af5072fc516288d1e1abb9ae0a215ce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67103562, jitterRate=-7.900595664978027E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:45,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af5072fc516288d1e1abb9ae0a215ce5: 2023-07-18 04:11:45,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5., pid=70, masterSystemTime=1689653505079 2023-07-18 04:11:45,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=af5072fc516288d1e1abb9ae0a215ce5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:45,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653505113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653505113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653505113"}]},"ts":"1689653505113"} 2023-07-18 04:11:45,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-18 04:11:45,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 30406878d4404e65db3f7156286fbb94, server=jenkins-hbase4.apache.org,36369,1689653423335 in 184 msec 2023-07-18 04:11:45,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, ASSIGN in 347 msec 2023-07-18 04:11:45,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-18 04:11:45,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure af5072fc516288d1e1abb9ae0a215ce5, server=jenkins-hbase4.apache.org,34797,1689653423262 in 188 msec 2023-07-18 04:11:45,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-18 04:11:45,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, ASSIGN in 352 msec 2023-07-18 04:11:45,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:45,121 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653505121"}]},"ts":"1689653505121"} 2023-07-18 04:11:45,123 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 04:11:45,128 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:45,128 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 04:11:45,130 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 04:11:45,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:45,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:45,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:45,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:45,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:45,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 490 msec 2023-07-18 04:11:45,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:45,264 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 04:11:45,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94], force=true 2023-07-18 04:11:45,305 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94], force=true 2023-07-18 04:11:45,305 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94], force=true 2023-07-18 04:11:45,305 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94], force=true 2023-07-18 04:11:45,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:45,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, UNASSIGN}] 2023-07-18 04:11:45,341 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, UNASSIGN 2023-07-18 04:11:45,341 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, UNASSIGN 2023-07-18 04:11:45,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=30406878d4404e65db3f7156286fbb94, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:45,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=af5072fc516288d1e1abb9ae0a215ce5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:45,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653505342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653505342"}]},"ts":"1689653505342"} 2023-07-18 04:11:45,343 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653505342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653505342"}]},"ts":"1689653505342"} 2023-07-18 04:11:45,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 30406878d4404e65db3f7156286fbb94, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:11:45,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure af5072fc516288d1e1abb9ae0a215ce5, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:45,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:45,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30406878d4404e65db3f7156286fbb94, disabling compactions & flushes 2023-07-18 04:11:45,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af5072fc516288d1e1abb9ae0a215ce5, disabling compactions & flushes 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. after waiting 0 ms 2023-07-18 04:11:45,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. after waiting 0 ms 2023-07-18 04:11:45,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 30406878d4404e65db3f7156286fbb94 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 04:11:45,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing af5072fc516288d1e1abb9ae0a215ce5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 04:11:45,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/.tmp/cf/bd9b398e0f3d46ebbc94d58308e4df81 2023-07-18 04:11:45,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/.tmp/cf/8d50777c4982468eba8f4eaafd174505 2023-07-18 04:11:45,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/.tmp/cf/bd9b398e0f3d46ebbc94d58308e4df81 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81 2023-07-18 04:11:45,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/.tmp/cf/8d50777c4982468eba8f4eaafd174505 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505 2023-07-18 04:11:45,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 04:11:45,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for af5072fc516288d1e1abb9ae0a215ce5 in 51ms, sequenceid=5, compaction requested=false 2023-07-18 04:11:45,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 04:11:45,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 04:11:45,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 30406878d4404e65db3f7156286fbb94 in 57ms, sequenceid=5, compaction requested=false 2023-07-18 04:11:45,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 04:11:45,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:45,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 04:11:45,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5. 2023-07-18 04:11:45,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af5072fc516288d1e1abb9ae0a215ce5: 2023-07-18 04:11:45,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:45,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94. 2023-07-18 04:11:45,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30406878d4404e65db3f7156286fbb94: 2023-07-18 04:11:45,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:11:45,570 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=af5072fc516288d1e1abb9ae0a215ce5, regionState=CLOSED 2023-07-18 04:11:45,570 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653505570"}]},"ts":"1689653505570"} 2023-07-18 04:11:45,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 30406878d4404e65db3f7156286fbb94 2023-07-18 04:11:45,572 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=30406878d4404e65db3f7156286fbb94, regionState=CLOSED 2023-07-18 04:11:45,572 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653505572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653505572"}]},"ts":"1689653505572"} 2023-07-18 04:11:45,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-18 04:11:45,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure af5072fc516288d1e1abb9ae0a215ce5, server=jenkins-hbase4.apache.org,34797,1689653423262 in 228 msec 2023-07-18 04:11:45,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-18 04:11:45,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 30406878d4404e65db3f7156286fbb94, server=jenkins-hbase4.apache.org,36369,1689653423335 in 238 msec 2023-07-18 04:11:45,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=af5072fc516288d1e1abb9ae0a215ce5, UNASSIGN in 256 msec 2023-07-18 04:11:45,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-18 04:11:45,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30406878d4404e65db3f7156286fbb94, UNASSIGN in 254 msec 2023-07-18 04:11:45,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:45,749 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 04:11:45,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504648.af5072fc516288d1e1abb9ae0a215ce5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:45,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653504648.30406878d4404e65db3f7156286fbb94.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:45,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:45,766 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:45,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, ASSIGN}] 2023-07-18 04:11:45,833 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, ASSIGN 2023-07-18 04:11:45,834 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:11:45,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:45,984 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:11:45,987 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ad2cab93adcb19c69ef495040d6acdbe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:45,987 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653505987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653505987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653505987"}]},"ts":"1689653505987"} 2023-07-18 04:11:45,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ad2cab93adcb19c69ef495040d6acdbe, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:11:46,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:11:46,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad2cab93adcb19c69ef495040d6acdbe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:11:46,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. service=AccessControlService 2023-07-18 04:11:46,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:46,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:46,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/.regioninfo 2023-07-18 04:11:46,170 INFO [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,171 DEBUG [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf 2023-07-18 04:11:46,171 DEBUG [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf 2023-07-18 04:11:46,171 INFO [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad2cab93adcb19c69ef495040d6acdbe columnFamilyName cf 2023-07-18 04:11:46,205 DEBUG [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] regionserver.HStore(539): loaded hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/8d50777c4982468eba8f4eaafd174505.30406878d4404e65db3f7156286fbb94->hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505-top 2023-07-18 04:11:46,213 DEBUG [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] regionserver.HStore(539): loaded hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/bd9b398e0f3d46ebbc94d58308e4df81.af5072fc516288d1e1abb9ae0a215ce5->hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81-top 2023-07-18 04:11:46,214 INFO [StoreOpener-ad2cab93adcb19c69ef495040d6acdbe-1] regionserver.HStore(310): Store=ad2cab93adcb19c69ef495040d6acdbe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:46,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:11:46,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad2cab93adcb19c69ef495040d6acdbe; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69636193, jitterRate=0.0376601368188858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:46,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad2cab93adcb19c69ef495040d6acdbe: 2023-07-18 04:11:46,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe., pid=77, masterSystemTime=1689653506145 2023-07-18 04:11:46,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.,because compaction is disabled. 2023-07-18 04:11:46,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:11:46,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:11:46,232 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ad2cab93adcb19c69ef495040d6acdbe, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653506232"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653506232"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653506232"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653506232"}]},"ts":"1689653506232"} 2023-07-18 04:11:46,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 04:11:46,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ad2cab93adcb19c69ef495040d6acdbe, server=jenkins-hbase4.apache.org,34797,1689653423262 in 245 msec 2023-07-18 04:11:46,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 04:11:46,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, ASSIGN in 407 msec 2023-07-18 04:11:46,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[af5072fc516288d1e1abb9ae0a215ce5, 30406878d4404e65db3f7156286fbb94], force=true in 945 msec 2023-07-18 04:11:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:46,416 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 04:11:46,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:46,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653506417 (current time:1689653506417). 2023-07-18 04:11:46,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:46,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x56348fce to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd7ac1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:46,433 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:46,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56348fce to 127.0.0.1:52746 2023-07-18 04:11:46,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:46,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x58b981fd to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:46,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a013fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:46,444 DEBUG [hconnection-0xc10d9c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:46,447 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:46,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:46,455 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58b981fd to 127.0.0.1:52746 2023-07-18 04:11:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 04:11:46,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:46,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:46,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:46,469 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:46,470 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689654106470 2023-07-18 04:11:46,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:46,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,475 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:46,475 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:46,480 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:46,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:46,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 13 msec 2023-07-18 04:11:46,495 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:46,496 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689654106496 2023-07-18 04:11:46,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,532 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 04:11:46,532 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:46,534 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 04:11:46,534 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 04:11:46,534 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,535 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,537 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,537 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,538 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,538 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:46,539 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:46,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:46,544 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:46,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,544 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:46,544 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:46,545 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:46,544 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:46,546 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:46,546 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:46,546 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,549 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,549 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,561 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,562 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:46,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:46,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 04:11:46,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68b930d9[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:46,564 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 04:11:46,564 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:46,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 04:11:46,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:46,591 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:46,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,592 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,592 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:46,591 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:11:46,594 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:46,594 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:46,595 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:11:46,595 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. started... 2023-07-18 04:11:46,597 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ad2cab93adcb19c69ef495040d6acdbe: 2023-07-18 04:11:46,597 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,598 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:46,598 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/8d50777c4982468eba8f4eaafd174505.30406878d4404e65db3f7156286fbb94->hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505-top, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/bd9b398e0f3d46ebbc94d58308e4df81.af5072fc516288d1e1abb9ae0a215ce5->hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81-top] hfiles 2023-07-18 04:11:46,598 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/8d50777c4982468eba8f4eaafd174505.30406878d4404e65db3f7156286fbb94 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,603 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/bd9b398e0f3d46ebbc94d58308e4df81.af5072fc516288d1e1abb9ae0a215ce5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:46,622 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:46,665 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. completed. 2023-07-18 04:11:46,666 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:11:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:11:46,676 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:46,676 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:46,676 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:46,778 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:46,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 04:11:46,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:46,779 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:46,796 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,796 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:46,796 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:11:46,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 04:11:46,801 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 04:11:46,801 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:46,801 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:46,802 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,802 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,804 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:46,805 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,807 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,807 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,809 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,810 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,810 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:46,814 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,815 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,815 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,815 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,815 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,815 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:11:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:46,815 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,816 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:11:46,816 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:11:46,816 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,816 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:46,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:46,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 04:11:46,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,924 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:46,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689653506471Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653506815 (+344 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653506815Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653506819 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653506843 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689653506924 (+81 ms) 2023-07-18 04:11:46,928 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:46,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 453 msec 2023-07-18 04:11:47,079 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:47,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 04:11:47,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:47,081 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081 2023-07-18 04:11:47,081 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45769, tgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081, rawTgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:11:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1008216077_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:47,106 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 04:11:47,126 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:47,159 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,159 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,160 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,160 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,160 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,161 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,161 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,246 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-1607450633279642730.jar 2023-07-18 04:11:47,246 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,247 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,247 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,247 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,248 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,248 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:47,249 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:47,249 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:47,250 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:47,251 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:47,251 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:47,252 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:47,252 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:47,253 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:47,253 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:47,253 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:11:47,254 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:47,254 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:47,255 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:47,255 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:47,255 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:47,256 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:47,256 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:47,257 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:48,450 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:48,453 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 04:11:48,456 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 04:11:48,973 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:48,973 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:49,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:56,081 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:58,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0005_000001 (auth:SIMPLE) 2023-07-18 04:12:01,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0005_000001 (auth:SIMPLE) 2023-07-18 04:12:03,186 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:12:03,199 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:12:03,217 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,217 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:12:03,218 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:12:03,218 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,219 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 04:12:03,219 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 04:12:03,219 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,219 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 04:12:03,219 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653507081/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 04:12:03,242 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,250 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653523250"}]},"ts":"1689653523250"} 2023-07-18 04:12:03,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 04:12:03,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:12:03,254 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 04:12:03,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, UNASSIGN}] 2023-07-18 04:12:03,258 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, UNASSIGN 2023-07-18 04:12:03,259 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ad2cab93adcb19c69ef495040d6acdbe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:03,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653523258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653523258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653523258"}]},"ts":"1689653523258"} 2023-07-18 04:12:03,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ad2cab93adcb19c69ef495040d6acdbe, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:03,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:12:03,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:12:03,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad2cab93adcb19c69ef495040d6acdbe, disabling compactions & flushes 2023-07-18 04:12:03,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:12:03,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:12:03,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. after waiting 0 ms 2023-07-18 04:12:03,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:12:03,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 04:12:03,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:03,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe. 2023-07-18 04:12:03,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad2cab93adcb19c69ef495040d6acdbe: 2023-07-18 04:12:03,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:12:03,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ad2cab93adcb19c69ef495040d6acdbe, regionState=CLOSED 2023-07-18 04:12:03,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653523428"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653523428"}]},"ts":"1689653523428"} 2023-07-18 04:12:03,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 04:12:03,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ad2cab93adcb19c69ef495040d6acdbe, server=jenkins-hbase4.apache.org,34797,1689653423262 in 170 msec 2023-07-18 04:12:03,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 04:12:03,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad2cab93adcb19c69ef495040d6acdbe, UNASSIGN in 177 msec 2023-07-18 04:12:03,434 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653523434"}]},"ts":"1689653523434"} 2023-07-18 04:12:03,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 04:12:03,437 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 04:12:03,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 194 msec 2023-07-18 04:12:03,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:12:03,556 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 04:12:03,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,560 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,562 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,565 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,565 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,565 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,566 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:12:03,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:12:03,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:12:03,566 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:12:03,566 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:12:03,566 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:12:03,567 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,567 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:03,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 04:12:03,567 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:12:03,567 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:03,567 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,568 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:03,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 04:12:03,569 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:03,569 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:03,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:03,572 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/recovered.edits] 2023-07-18 04:12:03,573 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/recovered.edits] 2023-07-18 04:12:03,573 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/recovered.edits] 2023-07-18 04:12:03,577 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/8d50777c4982468eba8f4eaafd174505.30406878d4404e65db3f7156286fbb94 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/8d50777c4982468eba8f4eaafd174505.30406878d4404e65db3f7156286fbb94 2023-07-18 04:12:03,578 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/cf/8d50777c4982468eba8f4eaafd174505 2023-07-18 04:12:03,578 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,578 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:03,579 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/cf/bd9b398e0f3d46ebbc94d58308e4df81 2023-07-18 04:12:03,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:03,580 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/bd9b398e0f3d46ebbc94d58308e4df81.af5072fc516288d1e1abb9ae0a215ce5 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/cf/bd9b398e0f3d46ebbc94d58308e4df81.af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:12:03,583 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/recovered.edits/8.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94/recovered.edits/8.seqid 2023-07-18 04:12:03,584 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/recovered.edits/8.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5/recovered.edits/8.seqid 2023-07-18 04:12:03,584 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30406878d4404e65db3f7156286fbb94 2023-07-18 04:12:03,584 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/af5072fc516288d1e1abb9ae0a215ce5 2023-07-18 04:12:03,586 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/recovered.edits/12.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe/recovered.edits/12.seqid 2023-07-18 04:12:03,586 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad2cab93adcb19c69ef495040d6acdbe 2023-07-18 04:12:03,586 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 04:12:03,588 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,591 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 04:12:03,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 04:12:03,594 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,594 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 04:12:03,594 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653523594"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:03,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 04:12:03,596 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ad2cab93adcb19c69ef495040d6acdbe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653504649.ad2cab93adcb19c69ef495040d6acdbe.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 04:12:03,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 04:12:03,596 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653523596"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:03,600 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 04:12:03,604 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:03,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 47 msec 2023-07-18 04:12:03,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 04:12:03,670 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 04:12:03,671 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:12:03,677 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653523676"}]},"ts":"1689653523676"} 2023-07-18 04:12:03,678 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 04:12:03,680 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 04:12:03,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, UNASSIGN}] 2023-07-18 04:12:03,684 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, UNASSIGN 2023-07-18 04:12:03,684 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, UNASSIGN 2023-07-18 04:12:03,685 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0151713b14e1ca20abff8f747121d2d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:03,685 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653523684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653523684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653523684"}]},"ts":"1689653523684"} 2023-07-18 04:12:03,685 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02bc6fba1ae9b0624bcbf438ef8d538b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:03,685 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653523685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653523685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653523685"}]},"ts":"1689653523685"} 2023-07-18 04:12:03,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0151713b14e1ca20abff8f747121d2d0, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:03,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 02bc6fba1ae9b0624bcbf438ef8d538b, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:12:03,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:12:03,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:12:03,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0151713b14e1ca20abff8f747121d2d0, disabling compactions & flushes 2023-07-18 04:12:03,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. after waiting 0 ms 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:12:03,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02bc6fba1ae9b0624bcbf438ef8d538b, disabling compactions & flushes 2023-07-18 04:12:03,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:12:03,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. after waiting 0 ms 2023-07-18 04:12:03,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:12:03,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:03,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:03,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0. 2023-07-18 04:12:03,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0151713b14e1ca20abff8f747121d2d0: 2023-07-18 04:12:03,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:12:03,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0151713b14e1ca20abff8f747121d2d0, regionState=CLOSED 2023-07-18 04:12:03,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653523865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653523865"}]},"ts":"1689653523865"} 2023-07-18 04:12:03,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:03,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-18 04:12:03,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:03,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0151713b14e1ca20abff8f747121d2d0, server=jenkins-hbase4.apache.org,34797,1689653423262 in 176 msec 2023-07-18 04:12:03,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b. 2023-07-18 04:12:03,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02bc6fba1ae9b0624bcbf438ef8d538b: 2023-07-18 04:12:03,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:12:03,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0151713b14e1ca20abff8f747121d2d0, UNASSIGN in 190 msec 2023-07-18 04:12:03,873 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02bc6fba1ae9b0624bcbf438ef8d538b, regionState=CLOSED 2023-07-18 04:12:03,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653523873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653523873"}]},"ts":"1689653523873"} 2023-07-18 04:12:03,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-18 04:12:03,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 02bc6fba1ae9b0624bcbf438ef8d538b, server=jenkins-hbase4.apache.org,36369,1689653423335 in 190 msec 2023-07-18 04:12:03,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-18 04:12:03,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02bc6fba1ae9b0624bcbf438ef8d538b, UNASSIGN in 202 msec 2023-07-18 04:12:03,886 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653523886"}]},"ts":"1689653523886"} 2023-07-18 04:12:03,887 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 04:12:03,889 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 04:12:03,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 219 msec 2023-07-18 04:12:03,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:12:03,979 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 04:12:03,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:03,997 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,000 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,002 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,002 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,002 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,002 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:04,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:04,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:04,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:04,006 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:12:04,006 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:12:04,008 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/recovered.edits] 2023-07-18 04:12:04,008 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/recovered.edits] 2023-07-18 04:12:04,015 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/cf/09132cc7407d47ba9ed541ec8905bdbb 2023-07-18 04:12:04,015 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/cf/1c97ad24d4ce4a6eac974aef22d7d101 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,016 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 04:12:04,020 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0/recovered.edits/9.seqid 2023-07-18 04:12:04,021 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b/recovered.edits/9.seqid 2023-07-18 04:12:04,021 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0151713b14e1ca20abff8f747121d2d0 2023-07-18 04:12:04,022 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02bc6fba1ae9b0624bcbf438ef8d538b 2023-07-18 04:12:04,022 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 04:12:04,026 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,029 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 04:12:04,034 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 04:12:04,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 04:12:04,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653524038"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:04,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653524038"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:04,040 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:04,040 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0151713b14e1ca20abff8f747121d2d0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653501976.0151713b14e1ca20abff8f747121d2d0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 02bc6fba1ae9b0624bcbf438ef8d538b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653501976.02bc6fba1ae9b0624bcbf438ef8d538b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:04,040 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 04:12:04,041 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653524040"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:04,042 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 04:12:04,044 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 64 msec 2023-07-18 04:12:04,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 04:12:04,119 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 04:12:04,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 04:12:04,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 04:12:04,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:04,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 04:12:04,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:04,184 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 751) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1981118642_1 at /127.0.0.1:45570 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1981118642_1 at /127.0.0.1:33866 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:33916 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:57744 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:39411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:45592 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4061 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:33904 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=383 (was 384), ProcessCount=183 (was 183), AvailableMemoryMB=2603 (was 3070) 2023-07-18 04:12:04,185 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-18 04:12:04,210 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=383, ProcessCount=183, AvailableMemoryMB=2602 2023-07-18 04:12:04,210 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-18 04:12:04,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:12:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:12:04,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 04:12:04,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:04,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:12:04,223 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,223 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,223 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 empty. 2023-07-18 04:12:04,223 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 empty. 2023-07-18 04:12:04,224 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,224 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,224 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 04:12:04,239 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 04:12:04,240 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 484cea7367e77dd044918a85fb4a21a9, NAME => 'testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:12:04,241 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d4c895dfdc34763fe0608a67d199a566, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:12:04,268 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:04,268 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 484cea7367e77dd044918a85fb4a21a9, disabling compactions & flushes 2023-07-18 04:12:04,269 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,269 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,269 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. after waiting 0 ms 2023-07-18 04:12:04,269 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,269 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,269 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 484cea7367e77dd044918a85fb4a21a9: 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d4c895dfdc34763fe0608a67d199a566, disabling compactions & flushes 2023-07-18 04:12:04,271 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. after waiting 0 ms 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,271 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d4c895dfdc34763fe0608a67d199a566: 2023-07-18 04:12:04,276 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:12:04,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653524277"}]},"ts":"1689653524277"} 2023-07-18 04:12:04,277 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653524277"}]},"ts":"1689653524277"} 2023-07-18 04:12:04,280 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:12:04,285 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:12:04,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653524286"}]},"ts":"1689653524286"} 2023-07-18 04:12:04,287 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 04:12:04,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:12:04,293 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:12:04,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:12:04,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:12:04,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:12:04,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, ASSIGN}] 2023-07-18 04:12:04,297 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, ASSIGN 2023-07-18 04:12:04,297 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, ASSIGN 2023-07-18 04:12:04,299 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:12:04,299 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40467,1689653423184; forceNewPlan=false, retain=false 2023-07-18 04:12:04,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:04,449 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:12:04,452 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=484cea7367e77dd044918a85fb4a21a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:04,452 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653524452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653524452"}]},"ts":"1689653524452"} 2023-07-18 04:12:04,453 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d4c895dfdc34763fe0608a67d199a566, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:04,453 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653524453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653524453"}]},"ts":"1689653524453"} 2023-07-18 04:12:04,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 484cea7367e77dd044918a85fb4a21a9, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:12:04,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d4c895dfdc34763fe0608a67d199a566, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:04,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:04,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 484cea7367e77dd044918a85fb4a21a9, NAME => 'testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4c895dfdc34763fe0608a67d199a566, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. service=AccessControlService 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. service=AccessControlService 2023-07-18 04:12:04,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:04,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,616 INFO [StoreOpener-484cea7367e77dd044918a85fb4a21a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,616 INFO [StoreOpener-d4c895dfdc34763fe0608a67d199a566-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,618 DEBUG [StoreOpener-484cea7367e77dd044918a85fb4a21a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf 2023-07-18 04:12:04,618 DEBUG [StoreOpener-484cea7367e77dd044918a85fb4a21a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf 2023-07-18 04:12:04,618 DEBUG [StoreOpener-d4c895dfdc34763fe0608a67d199a566-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf 2023-07-18 04:12:04,618 INFO [StoreOpener-484cea7367e77dd044918a85fb4a21a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 484cea7367e77dd044918a85fb4a21a9 columnFamilyName cf 2023-07-18 04:12:04,618 DEBUG [StoreOpener-d4c895dfdc34763fe0608a67d199a566-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf 2023-07-18 04:12:04,619 INFO [StoreOpener-d4c895dfdc34763fe0608a67d199a566-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4c895dfdc34763fe0608a67d199a566 columnFamilyName cf 2023-07-18 04:12:04,619 INFO [StoreOpener-484cea7367e77dd044918a85fb4a21a9-1] regionserver.HStore(310): Store=484cea7367e77dd044918a85fb4a21a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:04,619 INFO [StoreOpener-d4c895dfdc34763fe0608a67d199a566-1] regionserver.HStore(310): Store=d4c895dfdc34763fe0608a67d199a566/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:04,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:04,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:04,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:04,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 484cea7367e77dd044918a85fb4a21a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59653897, jitterRate=-0.11108766496181488}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:04,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:04,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 484cea7367e77dd044918a85fb4a21a9: 2023-07-18 04:12:04,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4c895dfdc34763fe0608a67d199a566; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69793930, jitterRate=0.04001060128211975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:04,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4c895dfdc34763fe0608a67d199a566: 2023-07-18 04:12:04,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9., pid=93, masterSystemTime=1689653524607 2023-07-18 04:12:04,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566., pid=94, masterSystemTime=1689653524607 2023-07-18 04:12:04,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:04,639 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=484cea7367e77dd044918a85fb4a21a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:04,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,639 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653524639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653524639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653524639"}]},"ts":"1689653524639"} 2023-07-18 04:12:04,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:04,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d4c895dfdc34763fe0608a67d199a566, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:04,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653524640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653524640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653524640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653524640"}]},"ts":"1689653524640"} 2023-07-18 04:12:04,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-18 04:12:04,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 484cea7367e77dd044918a85fb4a21a9, server=jenkins-hbase4.apache.org,40467,1689653423184 in 187 msec 2023-07-18 04:12:04,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-18 04:12:04,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d4c895dfdc34763fe0608a67d199a566, server=jenkins-hbase4.apache.org,34797,1689653423262 in 188 msec 2023-07-18 04:12:04,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, ASSIGN in 350 msec 2023-07-18 04:12:04,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 04:12:04,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, ASSIGN in 351 msec 2023-07-18 04:12:04,648 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:12:04,649 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653524649"}]},"ts":"1689653524649"} 2023-07-18 04:12:04,651 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 04:12:04,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:12:04,654 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 04:12:04,657 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:04,659 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,659 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,659 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,659 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:04,664 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,664 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,664 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,664 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:04,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:04,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:04,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:04,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 452 msec 2023-07-18 04:12:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:04,823 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 04:12:04,823 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 04:12:04,823 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:04,826 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 04:12:04,826 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:04,826 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-18 04:12:04,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:04,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653524829 (current time:1689653524829). 2023-07-18 04:12:04,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:04,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x694ed9ab to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:04,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7725b5fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:04,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:04,857 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:04,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x694ed9ab to 127.0.0.1:52746 2023-07-18 04:12:04,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:04,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x2e62c707 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:04,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31fec0e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:04,886 DEBUG [hconnection-0x6b2e117e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:04,890 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:04,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:04,898 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:04,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e62c707 to 127.0.0.1:52746 2023-07-18 04:12:04,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:04,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:04,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:04,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:04,905 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:04,906 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654124906 2023-07-18 04:12:04,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:04,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,915 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:04,923 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:04,923 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:04,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:04,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-18 04:12:04,938 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:04,941 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654124941 2023-07-18 04:12:05,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,009 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 04:12:05,009 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:05,011 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 04:12:05,011 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:12:05,011 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,012 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,017 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,017 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,017 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,018 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,018 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,018 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,019 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:05,019 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:05,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:05,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:05,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,021 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:05,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:05,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:05,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:05,022 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:05,022 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:05,023 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:05,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,024 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:05,025 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:05,025 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:05,025 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:05,025 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,026 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:05,029 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,030 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,030 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,031 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:05,031 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,031 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,031 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:05,032 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c72311f[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:05,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:05,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c72311f[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:05,038 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:12:05,038 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:05,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:05,040 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:12:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,040 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:05,040 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,040 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:05,042 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,042 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:05,042 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:05,046 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:05,046 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:05,046 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:05,046 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. started... 2023-07-18 04:12:05,046 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. started... 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d4c895dfdc34763fe0608a67d199a566: 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 484cea7367e77dd044918a85fb4a21a9: 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:05,049 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:05,103 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. completed. 2023-07-18 04:12:05,103 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:05,103 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. completed. 2023-07-18 04:12:05,103 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:05,103 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:05,103 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:12:05,104 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:12:05,106 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,106 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:05,106 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:05,107 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:05,109 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:05,109 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:12:05,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:12:05,120 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 04:12:05,120 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:05,120 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:05,120 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,120 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,123 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,124 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,124 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:05,124 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,125 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:05,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,127 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,127 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,128 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:05,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,132 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,132 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:05,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,134 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:05,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,233 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:05,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:05,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:05,235 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:12:05,535 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:05,537 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:12:05,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 04:12:05,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689653524907Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689653525134 (+227 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689653525134Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689653525144 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689653525576 (+432 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689653525606 (+30 ms) 2023-07-18 04:12:05,610 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:05,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 696 msec 2023-07-18 04:12:06,037 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:06,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:06,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:06,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40467] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:06,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:06,056 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:06,056 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:06,058 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:06,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653526075 (current time:1689653526075). 2023-07-18 04:12:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:06,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x60e29ea7 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:06,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b5cd624, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:06,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:06,107 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:06,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60e29ea7 to 127.0.0.1:52746 2023-07-18 04:12:06,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:06,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x56a3c712 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:06,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c07cc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:06,129 DEBUG [hconnection-0x3fb0634d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:06,130 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:06,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:06,135 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56a3c712 to 127.0.0.1:52746 2023-07-18 04:12:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:06,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:06,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:06,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:06,142 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:06,142 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654126142 2023-07-18 04:12:06,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:06,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:06,144 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:06,144 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:06,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:06,145 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:06,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-18 04:12:06,147 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:06,148 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654126148 2023-07-18 04:12:06,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,170 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 04:12:06,170 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:06,172 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 04:12:06,172 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:12:06,173 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,173 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,174 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,175 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,175 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,175 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,175 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,177 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:06,177 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:06,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:06,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:06,190 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:06,190 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:06,190 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:06,190 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:06,190 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:06,191 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:06,194 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,194 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,194 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e92fa3a[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:06,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:06,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e92fa3a[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:06,203 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:12:06,203 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,208 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,208 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,208 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,209 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:06,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,209 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:06,209 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:12:06,209 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,209 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. started... 2023-07-18 04:12:06,209 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:06,210 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d4c895dfdc34763fe0608a67d199a566 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 04:12:06,210 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:06,212 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:06,212 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:06,212 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. started... 2023-07-18 04:12:06,212 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 484cea7367e77dd044918a85fb4a21a9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 04:12:06,213 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:06,213 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:06,213 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:06,244 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:06,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:06,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:06,245 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:06,254 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/.tmp/cf/65310805df7145ceaeb0d9568a2306db 2023-07-18 04:12:06,258 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/.tmp/cf/0e72cba38c2f444abb1683b99d4b9993 2023-07-18 04:12:06,261 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/.tmp/cf/65310805df7145ceaeb0d9568a2306db as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db 2023-07-18 04:12:06,265 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/.tmp/cf/0e72cba38c2f444abb1683b99d4b9993 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993 2023-07-18 04:12:06,267 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 04:12:06,268 INFO [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 484cea7367e77dd044918a85fb4a21a9 in 56ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:06,269 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 04:12:06,269 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 484cea7367e77dd044918a85fb4a21a9: 2023-07-18 04:12:06,269 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,272 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:06,272 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db] hfiles 2023-07-18 04:12:06,272 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,273 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993, entries=47, sequenceid=6, filesize=8 K 2023-07-18 04:12:06,275 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for d4c895dfdc34763fe0608a67d199a566 in 65ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d4c895dfdc34763fe0608a67d199a566: 2023-07-18 04:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993] hfiles 2023-07-18 04:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,297 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. completed. 2023-07-18 04:12:06,298 DEBUG [rs(jenkins-hbase4.apache.org,40467,1689653423184)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:06,298 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:06,298 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:06,298 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,298 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:06,298 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:12:06,301 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:06,301 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:06,301 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:06,301 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40467,1689653423184': 2023-07-18 04:12:06,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:12:06,326 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. completed. 2023-07-18 04:12:06,326 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:06,326 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:06,327 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:06,327 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,327 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:06,327 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:06,329 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:06,329 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:12:06,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:12:06,345 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 04:12:06,346 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:06,346 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:06,346 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,346 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,349 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:06,349 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:06,350 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,355 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,355 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:06,356 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,373 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,373 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,373 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,373 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:06,374 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,374 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:06,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,377 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,377 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:06,377 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:06,377 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,377 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:06,446 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:06,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:06,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:06,449 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:12:06,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 04:12:06,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,573 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689653526143Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689653526374 (+231 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689653526374Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689653526409 (+35 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689653526486 (+77 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689653526572 (+86 ms) 2023-07-18 04:12:06,576 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:06,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 433 msec 2023-07-18 04:12:06,750 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:06,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:06,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:06,751 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751 2023-07-18 04:12:06,751 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45769, tgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751, rawTgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:12:06,774 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:12:06,774 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1813174684_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,774 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 04:12:06,784 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:06,814 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,814 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,815 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,816 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,816 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,885 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-1177208405898050861.jar 2023-07-18 04:12:06,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:06,888 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:12:06,888 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:12:06,888 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:12:06,889 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:12:06,889 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:12:06,890 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:12:06,890 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:12:06,890 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:12:06,890 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:12:06,891 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:12:06,891 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:06,892 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:06,892 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:06,892 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:06,892 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:06,893 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:06,893 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:07,549 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:12:07,552 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 04:12:08,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:08,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:08,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0005_000001 (auth:SIMPLE) 2023-07-18 04:12:08,775 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:09,067 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:15,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:18,002 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:12:18,007 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:12:18,015 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:18,015 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:12:18,015 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:12:18,016 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:18,016 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 04:12:18,016 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 04:12:18,016 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:18,017 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 04:12:18,017 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653526751/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 04:12:18,022 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:18,027 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653538027"}]},"ts":"1689653538027"} 2023-07-18 04:12:18,028 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 04:12:18,031 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 04:12:18,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, UNASSIGN}] 2023-07-18 04:12:18,036 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, UNASSIGN 2023-07-18 04:12:18,037 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, UNASSIGN 2023-07-18 04:12:18,037 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=484cea7367e77dd044918a85fb4a21a9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:18,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d4c895dfdc34763fe0608a67d199a566, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:18,037 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653538037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653538037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653538037"}]},"ts":"1689653538037"} 2023-07-18 04:12:18,037 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653538037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653538037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653538037"}]},"ts":"1689653538037"} 2023-07-18 04:12:18,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 484cea7367e77dd044918a85fb4a21a9, server=jenkins-hbase4.apache.org,40467,1689653423184}] 2023-07-18 04:12:18,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure d4c895dfdc34763fe0608a67d199a566, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:18,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:18,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:18,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4c895dfdc34763fe0608a67d199a566, disabling compactions & flushes 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 484cea7367e77dd044918a85fb4a21a9, disabling compactions & flushes 2023-07-18 04:12:18,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:18,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. after waiting 0 ms 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. after waiting 0 ms 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:18,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:18,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:18,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:18,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9. 2023-07-18 04:12:18,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 484cea7367e77dd044918a85fb4a21a9: 2023-07-18 04:12:18,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:18,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566. 2023-07-18 04:12:18,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4c895dfdc34763fe0608a67d199a566: 2023-07-18 04:12:18,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:18,210 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=484cea7367e77dd044918a85fb4a21a9, regionState=CLOSED 2023-07-18 04:12:18,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:18,210 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653538210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653538210"}]},"ts":"1689653538210"} 2023-07-18 04:12:18,211 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d4c895dfdc34763fe0608a67d199a566, regionState=CLOSED 2023-07-18 04:12:18,211 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653538211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653538211"}]},"ts":"1689653538211"} 2023-07-18 04:12:18,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 04:12:18,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 484cea7367e77dd044918a85fb4a21a9, server=jenkins-hbase4.apache.org,40467,1689653423184 in 172 msec 2023-07-18 04:12:18,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 04:12:18,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure d4c895dfdc34763fe0608a67d199a566, server=jenkins-hbase4.apache.org,34797,1689653423262 in 171 msec 2023-07-18 04:12:18,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=484cea7367e77dd044918a85fb4a21a9, UNASSIGN in 181 msec 2023-07-18 04:12:18,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-18 04:12:18,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d4c895dfdc34763fe0608a67d199a566, UNASSIGN in 182 msec 2023-07-18 04:12:18,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653538216"}]},"ts":"1689653538216"} 2023-07-18 04:12:18,218 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 04:12:18,219 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 04:12:18,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 198 msec 2023-07-18 04:12:18,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:18,330 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 04:12:18,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,338 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,339 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,343 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,343 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,343 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,343 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:18,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:18,346 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:18,346 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,347 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:18,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 04:12:18,349 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/recovered.edits] 2023-07-18 04:12:18,349 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/recovered.edits] 2023-07-18 04:12:18,355 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993 to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/cf/0e72cba38c2f444abb1683b99d4b9993 2023-07-18 04:12:18,356 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/cf/65310805df7145ceaeb0d9568a2306db 2023-07-18 04:12:18,364 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566/recovered.edits/9.seqid 2023-07-18 04:12:18,371 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/d4c895dfdc34763fe0608a67d199a566 2023-07-18 04:12:18,374 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9/recovered.edits/9.seqid 2023-07-18 04:12:18,374 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/484cea7367e77dd044918a85fb4a21a9 2023-07-18 04:12:18,375 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 04:12:18,377 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,389 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 04:12:18,391 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 04:12:18,394 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,394 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 04:12:18,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653538394"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:18,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653538394"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:18,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:18,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 484cea7367e77dd044918a85fb4a21a9, NAME => 'testtb-testEmptyExportFileSystemState,,1689653524212.484cea7367e77dd044918a85fb4a21a9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d4c895dfdc34763fe0608a67d199a566, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653524212.d4c895dfdc34763fe0608a67d199a566.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:18,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 04:12:18,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653538401"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:18,403 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 04:12:18,405 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:18,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 74 msec 2023-07-18 04:12:18,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 04:12:18,450 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 04:12:18,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 04:12:18,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:18,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 04:12:18,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:18,544 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 763) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:45563 from appattempt_1689653432320_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:38567 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:48378 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4712 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:51458 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1629500352_1 at /127.0.0.1:41104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:41128 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=488 (was 383) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1786 (was 2602) 2023-07-18 04:12:18,544 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 04:12:18,601 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=488, ProcessCount=183, AvailableMemoryMB=1785 2023-07-18 04:12:18,601 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 04:12:18,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:12:18,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,608 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:12:18,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 04:12:18,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:18,611 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:12:18,613 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:18,613 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:18,614 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 empty. 2023-07-18 04:12:18,614 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 empty. 2023-07-18 04:12:18,615 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:18,615 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:18,615 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 04:12:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:18,723 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 04:12:18,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce740a0ace8c60c563f0d412070d48d9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:12:18,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79b7dd7292b01b1494e49fecdc5216c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ce740a0ace8c60c563f0d412070d48d9, disabling compactions & flushes 2023-07-18 04:12:18,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. after waiting 0 ms 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:18,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:18,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ce740a0ace8c60c563f0d412070d48d9: 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 79b7dd7292b01b1494e49fecdc5216c4, disabling compactions & flushes 2023-07-18 04:12:18,823 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. after waiting 0 ms 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:18,823 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:18,823 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 79b7dd7292b01b1494e49fecdc5216c4: 2023-07-18 04:12:18,830 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:12:18,832 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653538831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653538831"}]},"ts":"1689653538831"} 2023-07-18 04:12:18,832 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653538831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653538831"}]},"ts":"1689653538831"} 2023-07-18 04:12:18,835 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:12:18,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:12:18,836 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653538836"}]},"ts":"1689653538836"} 2023-07-18 04:12:18,837 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 04:12:18,841 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:12:18,842 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:12:18,842 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:12:18,843 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:12:18,843 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:12:18,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, ASSIGN}] 2023-07-18 04:12:18,848 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, ASSIGN 2023-07-18 04:12:18,848 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, ASSIGN 2023-07-18 04:12:18,849 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1689653423335; forceNewPlan=false, retain=false 2023-07-18 04:12:18,849 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34797,1689653423262; forceNewPlan=false, retain=false 2023-07-18 04:12:18,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:19,000 INFO [jenkins-hbase4:39993] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:12:19,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ce740a0ace8c60c563f0d412070d48d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,004 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=79b7dd7292b01b1494e49fecdc5216c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653539004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653539004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653539004"}]},"ts":"1689653539004"} 2023-07-18 04:12:19,004 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653539004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653539004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653539004"}]},"ts":"1689653539004"} 2023-07-18 04:12:19,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure ce740a0ace8c60c563f0d412070d48d9, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:19,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 79b7dd7292b01b1494e49fecdc5216c4, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:12:19,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:19,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce740a0ace8c60c563f0d412070d48d9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:12:19,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. service=AccessControlService 2023-07-18 04:12:19,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:19,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:19,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,173 INFO [StoreOpener-ce740a0ace8c60c563f0d412070d48d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:19,176 DEBUG [StoreOpener-ce740a0ace8c60c563f0d412070d48d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf 2023-07-18 04:12:19,177 DEBUG [StoreOpener-ce740a0ace8c60c563f0d412070d48d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf 2023-07-18 04:12:19,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79b7dd7292b01b1494e49fecdc5216c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. service=AccessControlService 2023-07-18 04:12:19,177 INFO [StoreOpener-ce740a0ace8c60c563f0d412070d48d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce740a0ace8c60c563f0d412070d48d9 columnFamilyName cf 2023-07-18 04:12:19,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,178 INFO [StoreOpener-ce740a0ace8c60c563f0d412070d48d9-1] regionserver.HStore(310): Store=ce740a0ace8c60c563f0d412070d48d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:19,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:19,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:19,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce740a0ace8c60c563f0d412070d48d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71449485, jitterRate=0.06468029320240021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:19,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce740a0ace8c60c563f0d412070d48d9: 2023-07-18 04:12:19,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9., pid=108, masterSystemTime=1689653539159 2023-07-18 04:12:19,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:19,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:19,195 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ce740a0ace8c60c563f0d412070d48d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,195 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653539195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653539195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653539195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653539195"}]},"ts":"1689653539195"} 2023-07-18 04:12:19,199 INFO [StoreOpener-79b7dd7292b01b1494e49fecdc5216c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-18 04:12:19,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure ce740a0ace8c60c563f0d412070d48d9, server=jenkins-hbase4.apache.org,34797,1689653423262 in 191 msec 2023-07-18 04:12:19,201 DEBUG [StoreOpener-79b7dd7292b01b1494e49fecdc5216c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf 2023-07-18 04:12:19,202 DEBUG [StoreOpener-79b7dd7292b01b1494e49fecdc5216c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf 2023-07-18 04:12:19,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, ASSIGN in 357 msec 2023-07-18 04:12:19,202 INFO [StoreOpener-79b7dd7292b01b1494e49fecdc5216c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79b7dd7292b01b1494e49fecdc5216c4 columnFamilyName cf 2023-07-18 04:12:19,203 INFO [StoreOpener-79b7dd7292b01b1494e49fecdc5216c4-1] regionserver.HStore(310): Store=79b7dd7292b01b1494e49fecdc5216c4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:19,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:19,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:19,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79b7dd7292b01b1494e49fecdc5216c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71711576, jitterRate=0.06858575344085693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:19,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79b7dd7292b01b1494e49fecdc5216c4: 2023-07-18 04:12:19,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4., pid=109, masterSystemTime=1689653539164 2023-07-18 04:12:19,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:19,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:19,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=79b7dd7292b01b1494e49fecdc5216c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,235 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653539235"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653539235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653539235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653539235"}]},"ts":"1689653539235"} 2023-07-18 04:12:19,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-18 04:12:19,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 79b7dd7292b01b1494e49fecdc5216c4, server=jenkins-hbase4.apache.org,36369,1689653423335 in 227 msec 2023-07-18 04:12:19,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 04:12:19,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, ASSIGN in 406 msec 2023-07-18 04:12:19,252 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:12:19,252 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653539252"}]},"ts":"1689653539252"} 2023-07-18 04:12:19,253 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 04:12:19,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:12:19,256 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 04:12:19,257 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:19,260 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:19,260 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:19,260 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:19,260 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:19,261 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:19,261 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:19,261 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:19,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:19,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 657 msec 2023-07-18 04:12:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:19,716 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 04:12:19,716 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-18 04:12:19,717 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:19,720 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-18 04:12:19,720 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:19,720 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-18 04:12:19,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:19,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653539722 (current time:1689653539722). 2023-07-18 04:12:19,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:19,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x13fa004f to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:19,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@485db17b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:19,740 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:19,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13fa004f to 127.0.0.1:52746 2023-07-18 04:12:19,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:19,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x30ee792a to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:19,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d5ff00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:19,750 DEBUG [hconnection-0x56265e68-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:19,753 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:19,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:19,760 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:19,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30ee792a to 127.0.0.1:52746 2023-07-18 04:12:19,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:19,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:19,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:19,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:19,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:19,767 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:19,768 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689654139768 2023-07-18 04:12:19,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:19,770 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:19,770 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:19,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:19,772 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:19,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-18 04:12:19,774 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:19,777 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689654139777 2023-07-18 04:12:19,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,797 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:19,797 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:19,799 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 04:12:19,799 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 04:12:19,839 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:19,864 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,865 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,868 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,868 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,868 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,868 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,869 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,869 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:19,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:19,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:19,871 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:19,873 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:19,874 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:19,875 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:19,881 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,881 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:19,882 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,883 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:19,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,883 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:19,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:19,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f274983[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:19,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:19,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f274983[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:19,888 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 04:12:19,888 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:19,890 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,890 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:19,890 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. started... 2023-07-18 04:12:19,890 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:19,890 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:19,892 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. started... 2023-07-18 04:12:19,892 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79b7dd7292b01b1494e49fecdc5216c4: 2023-07-18 04:12:19,893 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce740a0ace8c60c563f0d412070d48d9: 2023-07-18 04:12:19,893 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,893 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:19,894 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,894 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:19,894 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:19,894 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:19,895 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:19,896 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:19,896 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:19,911 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. completed. 2023-07-18 04:12:19,911 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:19,911 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:19,912 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:19,912 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,912 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:19,912 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:12:19,913 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. completed. 2023-07-18 04:12:19,913 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:19,913 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:19,914 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:19,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:19,916 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:19,916 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:19,916 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:19,916 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:12:19,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 04:12:19,927 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 04:12:19,927 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:19,927 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:19,927 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,927 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,930 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:19,929 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,932 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,932 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:19,932 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:19,935 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,935 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,936 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:19,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,942 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,942 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,941 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,942 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:19,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:19,942 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,942 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:19,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,944 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:19,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,945 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:19,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:19,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 04:12:20,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,012 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689653539768Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653539942 (+174 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653539945 (+3 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653539955 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653539968 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689653540011 (+43 ms) 2023-07-18 04:12:20,015 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:20,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 246 msec 2023-07-18 04:12:20,075 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:20,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:20,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:20,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34797] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:20,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:20,088 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,088 DEBUG [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:20,088 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:20,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653540100 (current time:1689653540100). 2023-07-18 04:12:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x779b6074 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:20,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aaa5f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:20,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:20,110 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x779b6074 to 127.0.0.1:52746 2023-07-18 04:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(139): Connect 0x70b549d6 to 127.0.0.1:52746 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:20,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c810f74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:20,123 DEBUG [hconnection-0x1ac2ac38-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:20,126 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:20,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:20,134 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70b549d6 to 127.0.0.1:52746 2023-07-18 04:12:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:20,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:20,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:20,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:20,140 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:20,142 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689654140142 2023-07-18 04:12:20,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:20,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,144 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:20,144 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:20,146 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:20,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:20,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-18 04:12:20,156 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:20,157 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689654140157 2023-07-18 04:12:20,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,190 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:20,190 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:20,192 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 04:12:20,192 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 04:12:20,192 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,192 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,194 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,194 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,194 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,194 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,195 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:20,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:20,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40467,1689653423184' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,202 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:20,203 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,202 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:20,203 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34797,1689653423262' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e398946[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1689653423335' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e398946[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:20,208 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 04:12:20,209 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:20,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:20,216 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40467,1689653423184' in zk 2023-07-18 04:12:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,216 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:20,216 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,217 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:20,217 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:20,217 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:20,217 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. started... 2023-07-18 04:12:20,217 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. started... 2023-07-18 04:12:20,217 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ce740a0ace8c60c563f0d412070d48d9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 04:12:20,217 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79b7dd7292b01b1494e49fecdc5216c4 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 04:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40467,1689653423184' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:20,244 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:20,245 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/.tmp/cf/1fc61833153b41729189d21242eda85f 2023-07-18 04:12:20,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:20,245 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/.tmp/cf/97f8d5b1d0da486d97ec7dd7a194080d 2023-07-18 04:12:20,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:20,246 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:20,251 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/.tmp/cf/97f8d5b1d0da486d97ec7dd7a194080d as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d 2023-07-18 04:12:20,251 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/.tmp/cf/1fc61833153b41729189d21242eda85f as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f 2023-07-18 04:12:20,255 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 04:12:20,256 INFO [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ce740a0ace8c60c563f0d412070d48d9 in 39ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:20,258 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce740a0ace8c60c563f0d412070d48d9: 2023-07-18 04:12:20,258 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,258 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:20,258 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d] hfiles 2023-07-18 04:12:20,258 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,262 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f, entries=47, sequenceid=6, filesize=8 K 2023-07-18 04:12:20,263 INFO [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 79b7dd7292b01b1494e49fecdc5216c4 in 46ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:20,263 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79b7dd7292b01b1494e49fecdc5216c4: 2023-07-18 04:12:20,263 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,263 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:20,263 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f] hfiles 2023-07-18 04:12:20,263 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,271 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. completed. 2023-07-18 04:12:20,271 DEBUG [rs(jenkins-hbase4.apache.org,36369,1689653423335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:20,271 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36369,1689653423335' in zk 2023-07-18 04:12:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:20,273 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1689653423335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36369,1689653423335': 2023-07-18 04:12:20,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1689653423335' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 04:12:20,446 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:20,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:20,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:20,447 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:12:20,669 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. completed. 2023-07-18 04:12:20,669 DEBUG [rs(jenkins-hbase4.apache.org,34797,1689653423262)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:20,670 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:20,670 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:20,670 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,670 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:20,670 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34797,1689653423262' in zk 2023-07-18 04:12:20,671 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,34797,1689653423262' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34797,1689653423262': 2023-07-18 04:12:20,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34797,1689653423262' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 04:12:20,677 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 04:12:20,677 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:20,677 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:20,677 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,677 INFO [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:20,678 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:20,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:20,680 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,681 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:20,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,681 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:20,683 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,683 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,683 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,686 DEBUG [(jenkins-hbase4.apache.org,39993,1689653421600)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:20,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,686 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:20,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,688 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:20,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 04:12:20,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,721 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689653540142Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689653540688 (+546 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689653540688Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689653540691 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689653540699 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689653540720 (+21 ms) 2023-07-18 04:12:20,723 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:20,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 579 msec 2023-07-18 04:12:20,748 DEBUG [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:20,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:20,749 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749 2023-07-18 04:12:20,749 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45769, tgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749, rawTgtDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749, srcFsUri=hdfs://localhost:45769, srcDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:12:20,771 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0 2023-07-18 04:12:20,771 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_402622034_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,771 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45769, inputRoot=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0, snapshotDir=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 04:12:20,781 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:20,801 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,801 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,802 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,802 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,802 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,803 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,803 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,877 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/hadoop-8546691081189877381.jar 2023-07-18 04:12:20,877 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,878 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,878 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,879 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,879 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,879 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:20,880 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:12:20,881 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:12:20,881 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:12:20,882 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:12:20,882 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:12:20,883 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:12:20,883 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:12:20,884 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:12:20,884 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:12:20,885 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:12:20,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:20,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:20,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:20,886 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:20,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:20,887 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:20,888 DEBUG [Listener at jenkins-hbase4.apache.org/36671] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:21,565 WARN [Listener at jenkins-hbase4.apache.org/36671] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:12:21,568 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 04:12:21,570 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 04:12:23,118 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:23,118 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:23,127 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:23,195 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:23,838 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:29,353 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:31,666 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:36,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653432320_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:37,820 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:12:37,820 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:12:37,835 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,836 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:12:37,836 INFO [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:12:37,836 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,837 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 04:12:37,837 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 04:12:37,837 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_247121893_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,838 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 04:12:37,838 DEBUG [Listener at jenkins-hbase4.apache.org/36671] snapshot.TestExportSnapshot(367): hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/export-test/export-1689653540749/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 04:12:37,844 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,844 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:37,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:37,849 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653557849"}]},"ts":"1689653557849"} 2023-07-18 04:12:37,850 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 04:12:37,852 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 04:12:37,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, UNASSIGN}] 2023-07-18 04:12:37,856 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, UNASSIGN 2023-07-18 04:12:37,856 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, UNASSIGN 2023-07-18 04:12:37,858 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ce740a0ace8c60c563f0d412070d48d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:12:37,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653557858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653557858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653557858"}]},"ts":"1689653557858"} 2023-07-18 04:12:37,859 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=79b7dd7292b01b1494e49fecdc5216c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:12:37,859 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653557859"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653557859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653557859"}]},"ts":"1689653557859"} 2023-07-18 04:12:37,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ce740a0ace8c60c563f0d412070d48d9, server=jenkins-hbase4.apache.org,34797,1689653423262}] 2023-07-18 04:12:37,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 79b7dd7292b01b1494e49fecdc5216c4, server=jenkins-hbase4.apache.org,36369,1689653423335}] 2023-07-18 04:12:37,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:38,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:38,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce740a0ace8c60c563f0d412070d48d9, disabling compactions & flushes 2023-07-18 04:12:38,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:38,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:38,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. after waiting 0 ms 2023-07-18 04:12:38,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:38,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:38,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79b7dd7292b01b1494e49fecdc5216c4, disabling compactions & flushes 2023-07-18 04:12:38,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:38,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:38,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. after waiting 0 ms 2023-07-18 04:12:38,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:38,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:38,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:38,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9. 2023-07-18 04:12:38,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce740a0ace8c60c563f0d412070d48d9: 2023-07-18 04:12:38,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:38,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:38,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4. 2023-07-18 04:12:38,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:38,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79b7dd7292b01b1494e49fecdc5216c4: 2023-07-18 04:12:38,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ce740a0ace8c60c563f0d412070d48d9, regionState=CLOSED 2023-07-18 04:12:38,040 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653558040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653558040"}]},"ts":"1689653558040"} 2023-07-18 04:12:38,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:38,042 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=79b7dd7292b01b1494e49fecdc5216c4, regionState=CLOSED 2023-07-18 04:12:38,042 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653558042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653558042"}]},"ts":"1689653558042"} 2023-07-18 04:12:38,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-18 04:12:38,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ce740a0ace8c60c563f0d412070d48d9, server=jenkins-hbase4.apache.org,34797,1689653423262 in 180 msec 2023-07-18 04:12:38,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-18 04:12:38,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ce740a0ace8c60c563f0d412070d48d9, UNASSIGN in 192 msec 2023-07-18 04:12:38,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 79b7dd7292b01b1494e49fecdc5216c4, server=jenkins-hbase4.apache.org,36369,1689653423335 in 181 msec 2023-07-18 04:12:38,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-18 04:12:38,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=79b7dd7292b01b1494e49fecdc5216c4, UNASSIGN in 193 msec 2023-07-18 04:12:38,060 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653558060"}]},"ts":"1689653558060"} 2023-07-18 04:12:38,062 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 04:12:38,065 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 04:12:38,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 221 msec 2023-07-18 04:12:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:38,151 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 04:12:38,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,158 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34797] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,161 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,161 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,162 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,162 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:38,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:38,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:38,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:38,163 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:38,163 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:38,164 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:38,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 04:12:38,166 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/recovered.edits] 2023-07-18 04:12:38,167 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf, FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/recovered.edits] 2023-07-18 04:12:38,172 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/cf/97f8d5b1d0da486d97ec7dd7a194080d 2023-07-18 04:12:38,172 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/cf/1fc61833153b41729189d21242eda85f 2023-07-18 04:12:38,176 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9/recovered.edits/9.seqid 2023-07-18 04:12:38,177 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ce740a0ace8c60c563f0d412070d48d9 2023-07-18 04:12:38,177 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/recovered.edits/9.seqid to hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4/recovered.edits/9.seqid 2023-07-18 04:12:38,178 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/79b7dd7292b01b1494e49fecdc5216c4 2023-07-18 04:12:38,178 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 04:12:38,180 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,182 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 04:12:38,184 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 04:12:38,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 04:12:38,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653558185"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:38,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653558185"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:38,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:38,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ce740a0ace8c60c563f0d412070d48d9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653538603.ce740a0ace8c60c563f0d412070d48d9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 79b7dd7292b01b1494e49fecdc5216c4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653538603.79b7dd7292b01b1494e49fecdc5216c4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:38,187 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 04:12:38,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653558187"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:38,189 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 04:12:38,192 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-07-18 04:12:38,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 04:12:38,266 INFO [Listener at jenkins-hbase4.apache.org/36671] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 04:12:38,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 04:12:38,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,277 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 04:12:38,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39993] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:38,321 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=770 (was 764) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (551175601) connection to jenkins-hbase4.apache.org/172.31.14.131:39215 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:33074 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_402622034_17 at /127.0.0.1:57434 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_247121893_17 at /127.0.0.1:46362 [Waiting for operation #4] sun.nio.ch.FileDispatcherImpl.read0(Native Method) sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) sun.nio.ch.IOUtil.read(IOUtil.java:197) sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:615) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opReadBlock(Receiver.java:145) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:100) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_39924888_1 at /127.0.0.1:46356 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5321 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_39924888_1 at /127.0.0.1:33054 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x79c8fad-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=671 (was 488) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1131 (was 1785) 2023-07-18 04:12:38,321 WARN [Listener at jenkins-hbase4.apache.org/36671] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-18 04:12:38,321 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 04:12:38,338 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:12:38,461 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689653432320_0007_01_000001 is : 143 2023-07-18 04:12:43,609 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:52,470 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:06,587 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:06,588 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:06,696 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 04:13:06,705 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 04:13:06,707 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:06,722 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:06,826 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:06,826 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 04:13:06,826 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 04:13:06,826 INFO [Listener at jenkins-hbase4.apache.org/36671] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 04:13:06,826 DEBUG [Listener at jenkins-hbase4.apache.org/36671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x417fc4db to 127.0.0.1:52746 2023-07-18 04:13:06,826 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,826 DEBUG [Listener at jenkins-hbase4.apache.org/36671] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 04:13:06,827 DEBUG [Listener at jenkins-hbase4.apache.org/36671] util.JVMClusterUtil(257): Found active master hash=690030059, stopped=false 2023-07-18 04:13:06,827 DEBUG [Listener at jenkins-hbase4.apache.org/36671] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:06,827 DEBUG [Listener at jenkins-hbase4.apache.org/36671] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 04:13:06,827 INFO [Listener at jenkins-hbase4.apache.org/36671] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:13:06,829 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:06,829 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:06,829 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:13:06,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:06,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:06,829 INFO [Listener at jenkins-hbase4.apache.org/36671] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 04:13:06,829 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:06,830 DEBUG [Listener at jenkins-hbase4.apache.org/36671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ac0c05b to 127.0.0.1:52746 2023-07-18 04:13:06,830 DEBUG [Listener at jenkins-hbase4.apache.org/36671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,831 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40467,1689653423184' ***** 2023-07-18 04:13:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/36671] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:06,831 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:06,831 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:06,831 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34797,1689653423262' ***** 2023-07-18 04:13:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/36671] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:06,831 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:06,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:06,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:06,832 INFO [RS:1;jenkins-hbase4:34797] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:06,832 INFO [RS:1;jenkins-hbase4:34797] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:06,832 INFO [RS:1;jenkins-hbase4:34797] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:06,833 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(3305): Received CLOSE for 4541fbbe8eb478f581565f5e2ef604d4 2023-07-18 04:13:06,833 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(3305): Received CLOSE for ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:13:06,833 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:13:06,833 DEBUG [RS:1;jenkins-hbase4:34797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17494da9 to 127.0.0.1:52746 2023-07-18 04:13:06,831 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36369,1689653423335' ***** 2023-07-18 04:13:06,834 DEBUG [RS:1;jenkins-hbase4:34797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,834 DEBUG [Listener at jenkins-hbase4.apache.org/36671] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:06,835 INFO [Listener at jenkins-hbase4.apache.org/36671] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:06,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4541fbbe8eb478f581565f5e2ef604d4, disabling compactions & flushes 2023-07-18 04:13:06,835 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 04:13:06,836 INFO [RS:2;jenkins-hbase4:36369] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:06,835 INFO [RS:0;jenkins-hbase4:40467] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:06,836 INFO [RS:2;jenkins-hbase4:36369] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:06,836 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:06,836 INFO [RS:2;jenkins-hbase4:36369] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:06,834 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:06,836 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:13:06,836 INFO [RS:0;jenkins-hbase4:40467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:06,836 INFO [RS:0;jenkins-hbase4:40467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:06,836 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:13:06,836 DEBUG [RS:0;jenkins-hbase4:40467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4189b66a to 127.0.0.1:52746 2023-07-18 04:13:06,836 DEBUG [RS:0;jenkins-hbase4:40467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,836 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1478): Online Regions={4541fbbe8eb478f581565f5e2ef604d4=hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4., ec8a6e6a3ac1524ea65ff671e9675b2f=hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f.} 2023-07-18 04:13:06,840 INFO [RS:0;jenkins-hbase4:40467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:06,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:13:06,840 INFO [RS:0;jenkins-hbase4:40467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:06,840 INFO [RS:0;jenkins-hbase4:40467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:06,836 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62c44d46 to 127.0.0.1:52746 2023-07-18 04:13:06,840 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 04:13:06,836 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:06,840 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:13:06,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. after waiting 0 ms 2023-07-18 04:13:06,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:13:06,840 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 04:13:06,841 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36369,1689653423335; all regions closed. 2023-07-18 04:13:06,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4541fbbe8eb478f581565f5e2ef604d4 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 04:13:06,841 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-18 04:13:06,842 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1504): Waiting on 4541fbbe8eb478f581565f5e2ef604d4, ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:13:06,842 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 04:13:06,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 04:13:06,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 04:13:06,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 04:13:06,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 04:13:06,843 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 04:13:06,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 04:13:06,846 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:06,847 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:06,866 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:06,913 DEBUG [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs 2023-07-18 04:13:06,914 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36369%2C1689653423335:(num 1689653425570) 2023-07-18 04:13:06,914 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:06,914 INFO [RS:2;jenkins-hbase4:36369] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:06,927 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:06,927 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:06,927 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:06,927 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:06,927 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:06,934 INFO [RS:2;jenkins-hbase4:36369] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36369 2023-07-18 04:13:06,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/info/6d19e5a311ac44589ea54766d426f3e1 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1689653423335 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:06,947 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:06,948 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36369,1689653423335] 2023-07-18 04:13:06,949 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36369,1689653423335; numProcessing=1 2023-07-18 04:13:06,951 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36369,1689653423335 already deleted, retry=false 2023-07-18 04:13:06,951 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36369,1689653423335 expired; onlineServers=2 2023-07-18 04:13:06,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/.tmp/info/8f6ecfa3efd14226a8ad8fa095ae476f 2023-07-18 04:13:06,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d19e5a311ac44589ea54766d426f3e1 2023-07-18 04:13:06,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/.tmp/info/8f6ecfa3efd14226a8ad8fa095ae476f as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/info/8f6ecfa3efd14226a8ad8fa095ae476f 2023-07-18 04:13:06,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/info/8f6ecfa3efd14226a8ad8fa095ae476f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 04:13:06,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4541fbbe8eb478f581565f5e2ef604d4 in 146ms, sequenceid=6, compaction requested=false 2023-07-18 04:13:07,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/rep_barrier/db882b9af2ee45acb6a685ec76322452 2023-07-18 04:13:07,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db882b9af2ee45acb6a685ec76322452 2023-07-18 04:13:07,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/namespace/4541fbbe8eb478f581565f5e2ef604d4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:13:07,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:07,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:13:07,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4541fbbe8eb478f581565f5e2ef604d4: 2023-07-18 04:13:07,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689653426309.4541fbbe8eb478f581565f5e2ef604d4. 2023-07-18 04:13:07,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec8a6e6a3ac1524ea65ff671e9675b2f, disabling compactions & flushes 2023-07-18 04:13:07,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:13:07,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:13:07,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. after waiting 0 ms 2023-07-18 04:13:07,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:13:07,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec8a6e6a3ac1524ea65ff671e9675b2f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 04:13:07,043 DEBUG [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 04:13:07,043 DEBUG [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1504): Waiting on ec8a6e6a3ac1524ea65ff671e9675b2f 2023-07-18 04:13:07,051 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,051 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101769fa5880003, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,051 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36369,1689653423335; zookeeper connection closed. 2023-07-18 04:13:07,053 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@38f1e1dd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@38f1e1dd 2023-07-18 04:13:07,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/table/921fec60a011477985dfdf9d89f68bb8 2023-07-18 04:13:07,081 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 921fec60a011477985dfdf9d89f68bb8 2023-07-18 04:13:07,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/info/6d19e5a311ac44589ea54766d426f3e1 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/info/6d19e5a311ac44589ea54766d426f3e1 2023-07-18 04:13:07,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d19e5a311ac44589ea54766d426f3e1 2023-07-18 04:13:07,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/info/6d19e5a311ac44589ea54766d426f3e1, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 04:13:07,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/rep_barrier/db882b9af2ee45acb6a685ec76322452 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/rep_barrier/db882b9af2ee45acb6a685ec76322452 2023-07-18 04:13:07,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/.tmp/l/bdf8b25a4dec434385b1e3eff5599d3d 2023-07-18 04:13:07,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db882b9af2ee45acb6a685ec76322452 2023-07-18 04:13:07,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/rep_barrier/db882b9af2ee45acb6a685ec76322452, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 04:13:07,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdf8b25a4dec434385b1e3eff5599d3d 2023-07-18 04:13:07,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/.tmp/table/921fec60a011477985dfdf9d89f68bb8 as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/table/921fec60a011477985dfdf9d89f68bb8 2023-07-18 04:13:07,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/.tmp/l/bdf8b25a4dec434385b1e3eff5599d3d as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/l/bdf8b25a4dec434385b1e3eff5599d3d 2023-07-18 04:13:07,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdf8b25a4dec434385b1e3eff5599d3d 2023-07-18 04:13:07,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/l/bdf8b25a4dec434385b1e3eff5599d3d, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 04:13:07,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 921fec60a011477985dfdf9d89f68bb8 2023-07-18 04:13:07,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/table/921fec60a011477985dfdf9d89f68bb8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 04:13:07,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ec8a6e6a3ac1524ea65ff671e9675b2f in 71ms, sequenceid=18, compaction requested=false 2023-07-18 04:13:07,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 263ms, sequenceid=131, compaction requested=false 2023-07-18 04:13:07,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/acl/ec8a6e6a3ac1524ea65ff671e9675b2f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 04:13:07,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:07,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:13:07,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec8a6e6a3ac1524ea65ff671e9675b2f: 2023-07-18 04:13:07,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689653427074.ec8a6e6a3ac1524ea65ff671e9675b2f. 2023-07-18 04:13:07,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 04:13:07,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:07,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 04:13:07,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 04:13:07,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 04:13:07,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 04:13:07,243 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34797,1689653423262; all regions closed. 2023-07-18 04:13:07,243 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40467,1689653423184; all regions closed. 2023-07-18 04:13:07,264 DEBUG [RS:1;jenkins-hbase4:34797] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs 2023-07-18 04:13:07,264 INFO [RS:1;jenkins-hbase4:34797] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34797%2C1689653423262:(num 1689653425570) 2023-07-18 04:13:07,264 DEBUG [RS:1;jenkins-hbase4:34797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:07,264 INFO [RS:1;jenkins-hbase4:34797] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:07,265 INFO [RS:1;jenkins-hbase4:34797] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:07,265 INFO [RS:1;jenkins-hbase4:34797] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:07,265 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:07,265 INFO [RS:1;jenkins-hbase4:34797] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:07,266 INFO [RS:1;jenkins-hbase4:34797] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:07,267 INFO [RS:1;jenkins-hbase4:34797] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34797 2023-07-18 04:13:07,268 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:13:07,268 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34797,1689653423262 2023-07-18 04:13:07,268 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:07,269 DEBUG [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs 2023-07-18 04:13:07,269 INFO [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40467%2C1689653423184.meta:.meta(num 1689653425954) 2023-07-18 04:13:07,270 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34797,1689653423262] 2023-07-18 04:13:07,270 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34797,1689653423262; numProcessing=2 2023-07-18 04:13:07,272 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34797,1689653423262 already deleted, retry=false 2023-07-18 04:13:07,272 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34797,1689653423262 expired; onlineServers=1 2023-07-18 04:13:07,275 DEBUG [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/oldWALs 2023-07-18 04:13:07,275 INFO [RS:0;jenkins-hbase4:40467] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40467%2C1689653423184:(num 1689653425570) 2023-07-18 04:13:07,275 DEBUG [RS:0;jenkins-hbase4:40467] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:07,275 INFO [RS:0;jenkins-hbase4:40467] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:07,276 INFO [RS:0;jenkins-hbase4:40467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:07,276 INFO [RS:0;jenkins-hbase4:40467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40467 2023-07-18 04:13:07,277 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:07,278 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:07,278 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40467,1689653423184 2023-07-18 04:13:07,279 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40467,1689653423184] 2023-07-18 04:13:07,279 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40467,1689653423184; numProcessing=3 2023-07-18 04:13:07,281 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40467,1689653423184 already deleted, retry=false 2023-07-18 04:13:07,281 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40467,1689653423184 expired; onlineServers=0 2023-07-18 04:13:07,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39993,1689653421600' ***** 2023-07-18 04:13:07,281 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 04:13:07,281 DEBUG [M:0;jenkins-hbase4:39993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@681c0fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:13:07,281 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39993,1689653421600 2023-07-18 04:13:07,281 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39993,1689653421600; all regions closed. 2023-07-18 04:13:07,282 DEBUG [M:0;jenkins-hbase4:39993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:07,282 DEBUG [M:0;jenkins-hbase4:39993] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 04:13:07,282 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 04:13:07,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653425024] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653425024,5,FailOnTimeoutGroup] 2023-07-18 04:13:07,282 DEBUG [M:0;jenkins-hbase4:39993] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 04:13:07,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653425031] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653425031,5,FailOnTimeoutGroup] 2023-07-18 04:13:07,282 INFO [M:0;jenkins-hbase4:39993] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 04:13:07,282 INFO [M:0;jenkins-hbase4:39993] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 04:13:07,282 INFO [M:0;jenkins-hbase4:39993] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 04:13:07,282 DEBUG [M:0;jenkins-hbase4:39993] master.HMaster(1512): Stopping service threads 2023-07-18 04:13:07,282 INFO [M:0;jenkins-hbase4:39993] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 04:13:07,283 ERROR [M:0;jenkins-hbase4:39993] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 04:13:07,283 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 04:13:07,283 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:13:07,284 INFO [M:0;jenkins-hbase4:39993] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 04:13:07,284 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 04:13:07,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:13:07,284 DEBUG [M:0;jenkins-hbase4:39993] zookeeper.ZKUtil(398): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 04:13:07,284 WARN [M:0;jenkins-hbase4:39993] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 04:13:07,284 INFO [M:0;jenkins-hbase4:39993] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 04:13:07,284 INFO [M:0;jenkins-hbase4:39993] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 04:13:07,285 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 04:13:07,285 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:07,285 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:07,285 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 04:13:07,285 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:07,285 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.37 KB heapSize=449.57 KB 2023-07-18 04:13:07,370 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,370 INFO [RS:1;jenkins-hbase4:34797] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34797,1689653423262; zookeeper connection closed. 2023-07-18 04:13:07,370 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:34797-0x101769fa5880002, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,370 INFO [M:0;jenkins-hbase4:39993] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.37 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b9335c85fb124ae197708f4a9c1ea5fa 2023-07-18 04:13:07,371 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71cdc5a5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71cdc5a5 2023-07-18 04:13:07,376 INFO [M:0;jenkins-hbase4:39993] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9335c85fb124ae197708f4a9c1ea5fa 2023-07-18 04:13:07,377 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b9335c85fb124ae197708f4a9c1ea5fa as hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b9335c85fb124ae197708f4a9c1ea5fa 2023-07-18 04:13:07,383 INFO [M:0;jenkins-hbase4:39993] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9335c85fb124ae197708f4a9c1ea5fa 2023-07-18 04:13:07,383 INFO [M:0;jenkins-hbase4:39993] regionserver.HStore(1080): Added hdfs://localhost:45769/user/jenkins/test-data/df85943c-abd4-3016-8a8a-da6511dec4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b9335c85fb124ae197708f4a9c1ea5fa, entries=119, sequenceid=899, filesize=28.4 K 2023-07-18 04:13:07,384 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegion(2948): Finished flush of dataSize ~373.37 KB/382329, heapSize ~449.55 KB/460344, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 99ms, sequenceid=899, compaction requested=false 2023-07-18 04:13:07,386 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:07,386 DEBUG [M:0;jenkins-hbase4:39993] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:13:07,400 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:07,400 INFO [M:0;jenkins-hbase4:39993] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 04:13:07,401 INFO [M:0;jenkins-hbase4:39993] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39993 2023-07-18 04:13:07,405 DEBUG [M:0;jenkins-hbase4:39993] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39993,1689653421600 already deleted, retry=false 2023-07-18 04:13:07,470 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,470 INFO [RS:0;jenkins-hbase4:40467] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40467,1689653423184; zookeeper connection closed. 2023-07-18 04:13:07,470 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): regionserver:40467-0x101769fa5880001, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,470 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@617fe0fb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@617fe0fb 2023-07-18 04:13:07,471 INFO [Listener at jenkins-hbase4.apache.org/36671] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 04:13:07,570 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,570 INFO [M:0;jenkins-hbase4:39993] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39993,1689653421600; zookeeper connection closed. 2023-07-18 04:13:07,570 DEBUG [Listener at localhost/42327-EventThread] zookeeper.ZKWatcher(600): master:39993-0x101769fa5880000, quorum=127.0.0.1:52746, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:07,572 WARN [Listener at jenkins-hbase4.apache.org/36671] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:07,577 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:07,682 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:07,682 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-268785882-172.31.14.131-1689653417605 (Datanode Uuid a536d59f-d7a6-445e-a26c-c3b6292eb336) service to localhost/127.0.0.1:45769 2023-07-18 04:13:07,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data5/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data6/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,686 WARN [Listener at jenkins-hbase4.apache.org/36671] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:07,690 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:07,692 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:07,692 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-268785882-172.31.14.131-1689653417605 (Datanode Uuid 2d0747ef-6fd3-42f6-9da7-1346eab321dd) service to localhost/127.0.0.1:45769 2023-07-18 04:13:07,693 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data3/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,693 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data4/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,699 WARN [Listener at jenkins-hbase4.apache.org/36671] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:07,704 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:07,806 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:07,806 WARN [BP-268785882-172.31.14.131-1689653417605 heartbeating to localhost/127.0.0.1:45769] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-268785882-172.31.14.131-1689653417605 (Datanode Uuid 17e3e051-1b2c-4bfb-955b-03c80aee0cdd) service to localhost/127.0.0.1:45769 2023-07-18 04:13:07,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data1/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/083ebbca-4997-9ab2-edd4-0556e05a01d6/cluster_3fc44563-6455-64fd-63d5-fce669259c30/dfs/data/data2/current/BP-268785882-172.31.14.131-1689653417605] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:07,832 INFO [Listener at jenkins-hbase4.apache.org/36671] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:07,859 INFO [Listener at jenkins-hbase4.apache.org/36671] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 04:13:07,951 INFO [Listener at jenkins-hbase4.apache.org/36671] hbase.HBaseTestingUtility(1293): Minicluster is down