2023-07-19 00:10:13,641 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 00:10:13,914 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e 2023-07-19 00:10:13,914 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 00:10:13,950 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 00:10:14,182 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 00:10:14,183 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c, deleteOnExit=true 2023-07-19 00:10:14,183 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 00:10:14,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/test.cache.data in system properties and HBase conf 2023-07-19 00:10:14,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 00:10:14,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop.log.dir in system properties and HBase conf 2023-07-19 00:10:14,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 00:10:14,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 00:10:14,187 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 00:10:14,543 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 00:10:14,548 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:14,549 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:14,549 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 00:10:14,550 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:14,550 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 00:10:14,551 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 00:10:14,551 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:14,552 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:14,552 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 00:10:14,553 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/nfs.dump.dir in system properties and HBase conf 2023-07-19 00:10:14,553 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir in system properties and HBase conf 2023-07-19 00:10:14,553 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:14,554 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 00:10:14,554 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 00:10:15,202 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 00:10:15,206 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 00:10:15,472 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 00:10:15,632 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 00:10:15,645 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:15,678 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:15,717 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_localhost_33489_hdfs____.2xo41t/webapp 2023-07-19 00:10:15,886 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33489 2023-07-19 00:10:15,932 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 00:10:15,933 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 00:10:16,454 WARN [Listener at localhost/39213] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:16,548 WARN [Listener at localhost/39213] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:16,571 WARN [Listener at localhost/39213] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:16,578 INFO [Listener at localhost/39213] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:16,584 INFO [Listener at localhost/39213] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_localhost_34287_datanode____.mz2kq1/webapp 2023-07-19 00:10:16,744 INFO [Listener at localhost/39213] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34287 2023-07-19 00:10:17,311 WARN [Listener at localhost/45489] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:17,345 WARN [Listener at localhost/45489] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:17,355 WARN [Listener at localhost/45489] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:17,357 INFO [Listener at localhost/45489] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:17,362 INFO [Listener at localhost/45489] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_localhost_45485_datanode____.khxlop/webapp 2023-07-19 00:10:17,471 INFO [Listener at localhost/45489] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45485 2023-07-19 00:10:17,494 WARN [Listener at localhost/35069] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:17,532 WARN [Listener at localhost/35069] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 00:10:17,535 WARN [Listener at localhost/35069] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:17,537 INFO [Listener at localhost/35069] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:17,544 INFO [Listener at localhost/35069] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_localhost_43317_datanode____ka17kx/webapp 2023-07-19 00:10:17,732 INFO [Listener at localhost/35069] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43317 2023-07-19 00:10:17,764 WARN [Listener at localhost/46673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 00:10:18,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb067030dc3a7a70: Processing first storage report for DS-aeebf997-8065-4bbb-a54a-bef73909dbbc from datanode 12693aab-ed53-42b5-b0f6-edae9da1e9b5 2023-07-19 00:10:18,036 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb067030dc3a7a70: from storage DS-aeebf997-8065-4bbb-a54a-bef73909dbbc node DatanodeRegistration(127.0.0.1:46201, datanodeUuid=12693aab-ed53-42b5-b0f6-edae9da1e9b5, infoPort=45373, infoSecurePort=0, ipcPort=45489, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,036 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcaeb4b40d4382523: Processing first storage report for DS-29592445-e7b2-4caf-8da6-92eb5b553c6d from datanode 01df8280-e76c-4f12-a49c-6530628bd3ed 2023-07-19 00:10:18,036 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcaeb4b40d4382523: from storage DS-29592445-e7b2-4caf-8da6-92eb5b553c6d node DatanodeRegistration(127.0.0.1:45687, datanodeUuid=01df8280-e76c-4f12-a49c-6530628bd3ed, infoPort=41765, infoSecurePort=0, ipcPort=35069, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb067030dc3a7a70: Processing first storage report for DS-ee1ea02a-7429-47bd-8bd9-1bc5ad44d322 from datanode 12693aab-ed53-42b5-b0f6-edae9da1e9b5 2023-07-19 00:10:18,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb067030dc3a7a70: from storage DS-ee1ea02a-7429-47bd-8bd9-1bc5ad44d322 node DatanodeRegistration(127.0.0.1:46201, datanodeUuid=12693aab-ed53-42b5-b0f6-edae9da1e9b5, infoPort=45373, infoSecurePort=0, ipcPort=45489, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcaeb4b40d4382523: Processing first storage report for DS-b17e4c3e-ca6a-46de-b4fa-e13e7a79b2cd from datanode 01df8280-e76c-4f12-a49c-6530628bd3ed 2023-07-19 00:10:18,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcaeb4b40d4382523: from storage DS-b17e4c3e-ca6a-46de-b4fa-e13e7a79b2cd node DatanodeRegistration(127.0.0.1:45687, datanodeUuid=01df8280-e76c-4f12-a49c-6530628bd3ed, infoPort=41765, infoSecurePort=0, ipcPort=35069, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,061 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde8889d177cbd3c6: Processing first storage report for DS-c7bfc921-2b14-4923-8caa-062637a1561e from datanode a066e95d-e162-4931-842c-df3f032c8cab 2023-07-19 00:10:18,061 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde8889d177cbd3c6: from storage DS-c7bfc921-2b14-4923-8caa-062637a1561e node DatanodeRegistration(127.0.0.1:44793, datanodeUuid=a066e95d-e162-4931-842c-df3f032c8cab, infoPort=41301, infoSecurePort=0, ipcPort=46673, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,061 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde8889d177cbd3c6: Processing first storage report for DS-e9d80d4b-c342-4a22-b71f-a98b652e264f from datanode a066e95d-e162-4931-842c-df3f032c8cab 2023-07-19 00:10:18,061 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde8889d177cbd3c6: from storage DS-e9d80d4b-c342-4a22-b71f-a98b652e264f node DatanodeRegistration(127.0.0.1:44793, datanodeUuid=a066e95d-e162-4931-842c-df3f032c8cab, infoPort=41301, infoSecurePort=0, ipcPort=46673, storageInfo=lv=-57;cid=testClusterID;nsid=460863637;c=1689725415276), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 00:10:18,275 DEBUG [Listener at localhost/46673] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e 2023-07-19 00:10:18,363 INFO [Listener at localhost/46673] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/zookeeper_0, clientPort=55216, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 00:10:18,383 INFO [Listener at localhost/46673] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55216 2023-07-19 00:10:18,395 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:18,397 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:19,132 INFO [Listener at localhost/46673] util.FSUtils(471): Created version file at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b with version=8 2023-07-19 00:10:19,132 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/hbase-staging 2023-07-19 00:10:19,513 INFO [Listener at localhost/46673] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 00:10:20,124 INFO [Listener at localhost/46673] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,165 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,165 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,166 INFO [Listener at localhost/46673] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,166 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,166 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,347 INFO [Listener at localhost/46673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,453 DEBUG [Listener at localhost/46673] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 00:10:20,578 INFO [Listener at localhost/46673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35857 2023-07-19 00:10:20,594 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,596 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,619 INFO [Listener at localhost/46673] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35857 connecting to ZooKeeper ensemble=127.0.0.1:55216 2023-07-19 00:10:20,671 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:358570x0, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:20,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35857-0x1017aea3e690000 connected 2023-07-19 00:10:20,724 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:20,725 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:20,744 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:20,752 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35857 2023-07-19 00:10:20,753 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35857 2023-07-19 00:10:20,753 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35857 2023-07-19 00:10:20,754 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35857 2023-07-19 00:10:20,755 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35857 2023-07-19 00:10:20,762 INFO [Listener at localhost/46673] master.HMaster(444): hbase.rootdir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, hbase.cluster.distributed=false 2023-07-19 00:10:20,837 INFO [Listener at localhost/46673] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,837 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,837 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,837 INFO [Listener at localhost/46673] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,838 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,838 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,843 INFO [Listener at localhost/46673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,846 INFO [Listener at localhost/46673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33821 2023-07-19 00:10:20,849 INFO [Listener at localhost/46673] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:20,863 DEBUG [Listener at localhost/46673] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 00:10:20,865 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,867 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,869 INFO [Listener at localhost/46673] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33821 connecting to ZooKeeper ensemble=127.0.0.1:55216 2023-07-19 00:10:20,878 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:338210x0, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:20,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33821-0x1017aea3e690001 connected 2023-07-19 00:10:20,879 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:20,881 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:20,882 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:20,882 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33821 2023-07-19 00:10:20,883 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33821 2023-07-19 00:10:20,883 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33821 2023-07-19 00:10:20,886 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33821 2023-07-19 00:10:20,887 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33821 2023-07-19 00:10:20,903 INFO [Listener at localhost/46673] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,903 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,903 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,903 INFO [Listener at localhost/46673] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,904 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,904 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,904 INFO [Listener at localhost/46673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,906 INFO [Listener at localhost/46673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36575 2023-07-19 00:10:20,907 INFO [Listener at localhost/46673] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:20,909 DEBUG [Listener at localhost/46673] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 00:10:20,909 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,912 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,915 INFO [Listener at localhost/46673] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36575 connecting to ZooKeeper ensemble=127.0.0.1:55216 2023-07-19 00:10:20,920 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:365750x0, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:20,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36575-0x1017aea3e690002 connected 2023-07-19 00:10:20,922 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:20,923 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:20,924 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:20,927 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36575 2023-07-19 00:10:20,927 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36575 2023-07-19 00:10:20,931 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36575 2023-07-19 00:10:20,931 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36575 2023-07-19 00:10:20,931 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36575 2023-07-19 00:10:20,946 INFO [Listener at localhost/46673] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 00:10:20,947 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,947 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,947 INFO [Listener at localhost/46673] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 00:10:20,947 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 00:10:20,947 INFO [Listener at localhost/46673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 00:10:20,948 INFO [Listener at localhost/46673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 00:10:20,949 INFO [Listener at localhost/46673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42753 2023-07-19 00:10:20,950 INFO [Listener at localhost/46673] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 00:10:20,951 DEBUG [Listener at localhost/46673] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 00:10:20,952 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,954 INFO [Listener at localhost/46673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:20,955 INFO [Listener at localhost/46673] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42753 connecting to ZooKeeper ensemble=127.0.0.1:55216 2023-07-19 00:10:20,962 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:427530x0, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 00:10:20,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42753-0x1017aea3e690003 connected 2023-07-19 00:10:20,963 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:10:20,964 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:10:20,965 DEBUG [Listener at localhost/46673] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 00:10:20,967 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42753 2023-07-19 00:10:20,967 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42753 2023-07-19 00:10:20,972 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42753 2023-07-19 00:10:20,973 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42753 2023-07-19 00:10:20,974 DEBUG [Listener at localhost/46673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42753 2023-07-19 00:10:20,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:20,989 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 00:10:20,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:21,016 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,016 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,016 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,016 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 00:10:21,018 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:21,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 00:10:21,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35857,1689725419330 from backup master directory 2023-07-19 00:10:21,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 00:10:21,024 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:21,025 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 00:10:21,025 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:21,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:21,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 00:10:21,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 00:10:21,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/hbase.id with ID: ce015158-d66d-4457-b5af-2de82557e555 2023-07-19 00:10:21,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 00:10:21,229 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:21,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4882e9a1 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:21,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24972, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:21,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:21,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 00:10:21,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 00:10:21,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 00:10:21,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:21,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store-tmp 2023-07-19 00:10:21,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:21,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 00:10:21,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 00:10:21,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:10:21,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:10:21,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/WALs/jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:21,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35857%2C1689725419330, suffix=, logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/WALs/jenkins-hbase4.apache.org,35857,1689725419330, archiveDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/oldWALs, maxLogs=10 2023-07-19 00:10:21,656 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK] 2023-07-19 00:10:21,657 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK] 2023-07-19 00:10:21,656 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK] 2023-07-19 00:10:21,667 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 00:10:21,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/WALs/jenkins-hbase4.apache.org,35857,1689725419330/jenkins-hbase4.apache.org%2C35857%2C1689725419330.1689725421592 2023-07-19 00:10:21,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK], DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK], DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK]] 2023-07-19 00:10:21,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:21,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:21,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,830 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,839 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 00:10:21,877 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 00:10:21,895 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:21,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 00:10:21,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:21,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59908126, jitterRate=-0.10729935765266418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:21,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:10:21,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 00:10:21,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 00:10:21,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 00:10:21,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 00:10:21,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 00:10:22,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 54 msec 2023-07-19 00:10:22,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 00:10:22,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 00:10:22,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 00:10:22,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 00:10:22,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 00:10:22,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 00:10:22,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 00:10:22,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 00:10:22,141 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 00:10:22,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 00:10:22,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 00:10:22,171 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,171 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,171 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,171 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 00:10:22,171 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35857,1689725419330, sessionid=0x1017aea3e690000, setting cluster-up flag (Was=false) 2023-07-19 00:10:22,201 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 00:10:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:22,222 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:22,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 00:10:22,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:22,236 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp 2023-07-19 00:10:22,293 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(951): ClusterId : ce015158-d66d-4457-b5af-2de82557e555 2023-07-19 00:10:22,309 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(951): ClusterId : ce015158-d66d-4457-b5af-2de82557e555 2023-07-19 00:10:22,319 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(951): ClusterId : ce015158-d66d-4457-b5af-2de82557e555 2023-07-19 00:10:22,322 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,322 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,323 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 00:10:22,332 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,332 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,332 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,332 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,332 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 00:10:22,334 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 00:10:22,339 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,341 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,342 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ReadOnlyZKClient(139): Connect 0x0619b452 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,348 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 00:10:22,351 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ReadOnlyZKClient(139): Connect 0x4a554aa1 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,355 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ReadOnlyZKClient(139): Connect 0x714db376 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:22,373 DEBUG [RS:1;jenkins-hbase4:36575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13621703, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,374 DEBUG [RS:1;jenkins-hbase4:36575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25d5e600, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,375 DEBUG [RS:2;jenkins-hbase4:42753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4492bd9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,375 DEBUG [RS:2;jenkins-hbase4:42753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ad21d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 00:10:22,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 00:10:22,417 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36575 2023-07-19 00:10:22,421 DEBUG [RS:0;jenkins-hbase4:33821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d17ea26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:22,422 DEBUG [RS:0;jenkins-hbase4:33821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6da7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:10:22,423 INFO [RS:1;jenkins-hbase4:36575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,423 INFO [RS:1;jenkins-hbase4:36575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,424 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,432 INFO [RS:1;jenkins-hbase4:36575] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,433 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,436 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:36575, startcode=1689725420902 2023-07-19 00:10:22,435 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42753 2023-07-19 00:10:22,442 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33821 2023-07-19 00:10:22,442 INFO [RS:0;jenkins-hbase4:33821] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,443 INFO [RS:0;jenkins-hbase4:33821] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,443 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,443 INFO [RS:0;jenkins-hbase4:33821] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,443 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,444 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:33821, startcode=1689725420836 2023-07-19 00:10:22,437 INFO [RS:2;jenkins-hbase4:42753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 00:10:22,445 INFO [RS:2;jenkins-hbase4:42753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 00:10:22,445 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 00:10:22,445 INFO [RS:2;jenkins-hbase4:42753] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:22,445 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 00:10:22,447 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:42753, startcode=1689725420945 2023-07-19 00:10:22,462 DEBUG [RS:1;jenkins-hbase4:36575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,463 DEBUG [RS:0;jenkins-hbase4:33821] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,470 DEBUG [RS:2;jenkins-hbase4:42753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 00:10:22,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:22,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 00:10:22,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 00:10:22,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:22,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689725452550 2023-07-19 00:10:22,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 00:10:22,559 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:22,560 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 00:10:22,561 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33671, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,561 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33723, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,561 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43745, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 00:10:22,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 00:10:22,573 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,573 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:22,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 00:10:22,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 00:10:22,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 00:10:22,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 00:10:22,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,584 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,604 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 00:10:22,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 00:10:22,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 00:10:22,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 00:10:22,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 00:10:22,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 00:10:22,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422618,5,FailOnTimeoutGroup] 2023-07-19 00:10:22,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422623,5,FailOnTimeoutGroup] 2023-07-19 00:10:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 00:10:22,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,635 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,636 WARN [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,647 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,647 WARN [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,647 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 00:10:22,647 WARN [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 00:10:22,694 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:22,695 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:22,696 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:22,731 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:22,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 00:10:22,737 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:42753, startcode=1689725420945 2023-07-19 00:10:22,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/info 2023-07-19 00:10:22,741 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 00:10:22,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 00:10:22,744 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,747 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:22,748 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:33821, startcode=1689725420836 2023-07-19 00:10:22,748 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35857,1689725419330 with isa=jenkins-hbase4.apache.org/172.31.14.131:36575, startcode=1689725420902 2023-07-19 00:10:22,748 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 00:10:22,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 00:10:22,756 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:22,757 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39213 2023-07-19 00:10:22,761 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,762 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,763 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/table 2023-07-19 00:10:22,764 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:22,764 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39213 2023-07-19 00:10:22,764 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,765 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:22,765 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39213 2023-07-19 00:10:22,765 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 00:10:22,765 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 00:10:22,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:22,771 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:10:22,772 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740 2023-07-19 00:10:22,772 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740 2023-07-19 00:10:22,777 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 00:10:22,781 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ZKUtil(162): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,782 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 00:10:22,782 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ZKUtil(162): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,781 WARN [RS:1;jenkins-hbase4:36575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,782 WARN [RS:0;jenkins-hbase4:33821] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,792 INFO [RS:1;jenkins-hbase4:36575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,793 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36575,1689725420902] 2023-07-19 00:10:22,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42753,1689725420945] 2023-07-19 00:10:22,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33821,1689725420836] 2023-07-19 00:10:22,794 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,794 WARN [RS:2;jenkins-hbase4:42753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 00:10:22,792 INFO [RS:0;jenkins-hbase4:33821] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,795 INFO [RS:2;jenkins-hbase4:42753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:22,802 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,802 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,818 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:22,825 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60167927, jitterRate=-0.10342802107334137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 00:10:22,825 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 00:10:22,825 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 00:10:22,825 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 00:10:22,825 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 00:10:22,825 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 00:10:22,826 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 00:10:22,827 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 00:10:22,827 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 00:10:22,829 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ZKUtil(162): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,829 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ZKUtil(162): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,830 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ZKUtil(162): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,830 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ZKUtil(162): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,830 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ZKUtil(162): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,831 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ZKUtil(162): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,832 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:22,834 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 00:10:22,834 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 00:10:22,835 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:22,836 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ZKUtil(162): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:22,846 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,846 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,846 DEBUG [RS:2;jenkins-hbase4:42753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 00:10:22,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 00:10:22,858 INFO [RS:1;jenkins-hbase4:36575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 00:10:22,867 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 00:10:22,870 INFO [RS:0;jenkins-hbase4:33821] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,870 INFO [RS:2;jenkins-hbase4:42753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 00:10:22,893 INFO [RS:2;jenkins-hbase4:42753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:22,895 INFO [RS:1;jenkins-hbase4:36575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:22,898 INFO [RS:0;jenkins-hbase4:33821] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 00:10:22,899 INFO [RS:2;jenkins-hbase4:42753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:22,899 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,900 INFO [RS:1;jenkins-hbase4:36575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:22,900 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:22,900 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,901 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:22,902 INFO [RS:0;jenkins-hbase4:33821] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 00:10:22,902 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,903 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 00:10:22,913 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,913 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,913 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,914 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,914 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,915 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:22,916 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:22,916 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 00:10:22,916 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:1;jenkins-hbase4:36575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:0;jenkins-hbase4:33821] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,916 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,917 DEBUG [RS:2;jenkins-hbase4:42753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 00:10:22,943 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,944 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,944 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,950 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,951 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,951 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,954 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,954 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,954 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,976 INFO [RS:2;jenkins-hbase4:42753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:22,976 INFO [RS:1;jenkins-hbase4:36575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:22,982 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42753,1689725420945-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,987 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36575,1689725420902-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:22,996 INFO [RS:0;jenkins-hbase4:33821] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 00:10:22,996 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33821,1689725420836-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,019 DEBUG [jenkins-hbase4:35857] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 00:10:23,023 INFO [RS:0;jenkins-hbase4:33821] regionserver.Replication(203): jenkins-hbase4.apache.org,33821,1689725420836 started 2023-07-19 00:10:23,023 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33821,1689725420836, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33821, sessionid=0x1017aea3e690001 2023-07-19 00:10:23,024 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,024 DEBUG [RS:0;jenkins-hbase4:33821] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:23,024 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33821,1689725420836' 2023-07-19 00:10:23,024 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,025 DEBUG [jenkins-hbase4:35857] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:23,025 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,026 INFO [RS:2;jenkins-hbase4:42753] regionserver.Replication(203): jenkins-hbase4.apache.org,42753,1689725420945 started 2023-07-19 00:10:23,026 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42753,1689725420945, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42753, sessionid=0x1017aea3e690003 2023-07-19 00:10:23,026 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,026 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,026 DEBUG [RS:0;jenkins-hbase4:33821] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:23,027 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33821,1689725420836' 2023-07-19 00:10:23,027 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,031 DEBUG [RS:0;jenkins-hbase4:33821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,033 INFO [RS:1;jenkins-hbase4:36575] regionserver.Replication(203): jenkins-hbase4.apache.org,36575,1689725420902 started 2023-07-19 00:10:23,033 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36575,1689725420902, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36575, sessionid=0x1017aea3e690002 2023-07-19 00:10:23,033 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,033 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 00:10:23,034 DEBUG [RS:1;jenkins-hbase4:36575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:23,039 DEBUG [RS:0;jenkins-hbase4:33821] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,039 INFO [RS:0;jenkins-hbase4:33821] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,039 INFO [RS:0;jenkins-hbase4:33821] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,034 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36575,1689725420902' 2023-07-19 00:10:23,040 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,033 DEBUG [RS:2;jenkins-hbase4:42753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:23,040 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42753,1689725420945' 2023-07-19 00:10:23,040 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 00:10:23,041 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,041 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 00:10:23,041 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,041 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,041 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 00:10:23,042 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 00:10:23,042 DEBUG [RS:1;jenkins-hbase4:36575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:23,043 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36575,1689725420902' 2023-07-19 00:10:23,043 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,045 DEBUG [RS:1;jenkins-hbase4:36575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,046 DEBUG [jenkins-hbase4:35857] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:23,046 DEBUG [jenkins-hbase4:35857] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:23,046 DEBUG [jenkins-hbase4:35857] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:23,046 DEBUG [jenkins-hbase4:35857] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:23,049 DEBUG [RS:2;jenkins-hbase4:42753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:23,049 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42753,1689725420945' 2023-07-19 00:10:23,049 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:23,050 DEBUG [RS:1;jenkins-hbase4:36575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,050 INFO [RS:1;jenkins-hbase4:36575] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,051 INFO [RS:1;jenkins-hbase4:36575] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,053 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33821,1689725420836, state=OPENING 2023-07-19 00:10:23,054 DEBUG [RS:2;jenkins-hbase4:42753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:23,058 DEBUG [RS:2;jenkins-hbase4:42753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 00:10:23,059 INFO [RS:2;jenkins-hbase4:42753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 00:10:23,059 INFO [RS:2;jenkins-hbase4:42753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 00:10:23,063 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 00:10:23,065 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:23,066 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 00:10:23,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:10:23,159 INFO [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33821%2C1689725420836, suffix=, logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,33821,1689725420836, archiveDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs, maxLogs=32 2023-07-19 00:10:23,159 INFO [RS:1;jenkins-hbase4:36575] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36575%2C1689725420902, suffix=, logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,36575,1689725420902, archiveDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs, maxLogs=32 2023-07-19 00:10:23,165 INFO [RS:2;jenkins-hbase4:42753] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42753%2C1689725420945, suffix=, logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,42753,1689725420945, archiveDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs, maxLogs=32 2023-07-19 00:10:23,227 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK] 2023-07-19 00:10:23,228 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK] 2023-07-19 00:10:23,228 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK] 2023-07-19 00:10:23,241 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK] 2023-07-19 00:10:23,241 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK] 2023-07-19 00:10:23,242 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK] 2023-07-19 00:10:23,262 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK] 2023-07-19 00:10:23,262 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK] 2023-07-19 00:10:23,262 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK] 2023-07-19 00:10:23,266 INFO [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,33821,1689725420836/jenkins-hbase4.apache.org%2C33821%2C1689725420836.1689725423164 2023-07-19 00:10:23,268 DEBUG [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK], DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK], DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK]] 2023-07-19 00:10:23,271 INFO [RS:2;jenkins-hbase4:42753] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,42753,1689725420945/jenkins-hbase4.apache.org%2C42753%2C1689725420945.1689725423167 2023-07-19 00:10:23,273 DEBUG [RS:2;jenkins-hbase4:42753] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK], DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK], DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK]] 2023-07-19 00:10:23,286 INFO [RS:1;jenkins-hbase4:36575] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,36575,1689725420902/jenkins-hbase4.apache.org%2C36575%2C1689725420902.1689725423175 2023-07-19 00:10:23,286 DEBUG [RS:1;jenkins-hbase4:36575] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK], DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK], DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK]] 2023-07-19 00:10:23,289 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:23,292 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:23,296 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:23,313 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 00:10:23,314 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 00:10:23,318 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33821%2C1689725420836.meta, suffix=.meta, logDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,33821,1689725420836, archiveDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs, maxLogs=32 2023-07-19 00:10:23,356 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK] 2023-07-19 00:10:23,358 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK] 2023-07-19 00:10:23,357 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK] 2023-07-19 00:10:23,393 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/WALs/jenkins-hbase4.apache.org,33821,1689725420836/jenkins-hbase4.apache.org%2C33821%2C1689725420836.meta.1689725423319.meta 2023-07-19 00:10:23,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45687,DS-29592445-e7b2-4caf-8da6-92eb5b553c6d,DISK], DatanodeInfoWithStorage[127.0.0.1:46201,DS-aeebf997-8065-4bbb-a54a-bef73909dbbc,DISK], DatanodeInfoWithStorage[127.0.0.1:44793,DS-c7bfc921-2b14-4923-8caa-062637a1561e,DISK]] 2023-07-19 00:10:23,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:23,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 00:10:23,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:23,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 00:10:23,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 00:10:23,402 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 00:10:23,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 00:10:23,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:23,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 00:10:23,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 00:10:23,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 00:10:23,428 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/info 2023-07-19 00:10:23,428 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/info 2023-07-19 00:10:23,429 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 00:10:23,430 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,430 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 00:10:23,433 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:23,433 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/rep_barrier 2023-07-19 00:10:23,433 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 00:10:23,434 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 00:10:23,436 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/table 2023-07-19 00:10:23,436 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/table 2023-07-19 00:10:23,437 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 00:10:23,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:23,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740 2023-07-19 00:10:23,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740 2023-07-19 00:10:23,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 00:10:23,454 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 00:10:23,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73092928, jitterRate=0.08916950225830078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 00:10:23,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 00:10:23,479 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689725423272 2023-07-19 00:10:23,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 00:10:23,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 00:10:23,501 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33821,1689725420836, state=OPEN 2023-07-19 00:10:23,507 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 00:10:23,507 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 00:10:23,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 00:10:23,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33821,1689725420836 in 436 msec 2023-07-19 00:10:23,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 00:10:23,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 670 msec 2023-07-19 00:10:23,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1410 sec 2023-07-19 00:10:23,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689725423542, completionTime=-1 2023-07-19 00:10:23,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 00:10:23,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 00:10:23,622 DEBUG [hconnection-0x1950a9ad-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:23,630 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:23,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 00:10:23,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689725483668 2023-07-19 00:10:23,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689725543668 2023-07-19 00:10:23,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 124 msec 2023-07-19 00:10:23,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35857,1689725419330-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35857,1689725419330-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35857,1689725419330-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35857, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 00:10:23,730 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 00:10:23,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 00:10:23,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:23,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 00:10:23,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:23,771 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:23,796 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/namespace/2a960486aff1fc768be04749de29033f 2023-07-19 00:10:23,799 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/namespace/2a960486aff1fc768be04749de29033f empty. 2023-07-19 00:10:23,800 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/namespace/2a960486aff1fc768be04749de29033f 2023-07-19 00:10:23,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 00:10:23,858 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:23,861 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a960486aff1fc768be04749de29033f, NAME => 'hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2a960486aff1fc768be04749de29033f, disabling compactions & flushes 2023-07-19 00:10:23,888 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. after waiting 0 ms 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:23,888 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:23,888 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2a960486aff1fc768be04749de29033f: 2023-07-19 00:10:23,893 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:23,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725423897"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725423897"}]},"ts":"1689725423897"} 2023-07-19 00:10:23,942 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 00:10:23,947 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:23,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725423947"}]},"ts":"1689725423947"} 2023-07-19 00:10:23,963 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 00:10:23,972 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:23,974 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:23,974 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:23,974 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:23,974 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:23,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2a960486aff1fc768be04749de29033f, ASSIGN}] 2023-07-19 00:10:23,984 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2a960486aff1fc768be04749de29033f, ASSIGN 2023-07-19 00:10:23,989 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2a960486aff1fc768be04749de29033f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36575,1689725420902; forceNewPlan=false, retain=false 2023-07-19 00:10:24,142 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:10:24,144 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2a960486aff1fc768be04749de29033f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:24,144 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725424143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725424143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725424143"}]},"ts":"1689725424143"} 2023-07-19 00:10:24,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2a960486aff1fc768be04749de29033f, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:10:24,315 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:24,315 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:24,320 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:24,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:24,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a960486aff1fc768be04749de29033f, NAME => 'hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:24,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. service=AccessControlService 2023-07-19 00:10:24,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:24,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:24,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,334 INFO [StoreOpener-2a960486aff1fc768be04749de29033f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,337 DEBUG [StoreOpener-2a960486aff1fc768be04749de29033f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/info 2023-07-19 00:10:24,337 DEBUG [StoreOpener-2a960486aff1fc768be04749de29033f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/info 2023-07-19 00:10:24,337 INFO [StoreOpener-2a960486aff1fc768be04749de29033f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a960486aff1fc768be04749de29033f columnFamilyName info 2023-07-19 00:10:24,338 INFO [StoreOpener-2a960486aff1fc768be04749de29033f-1] regionserver.HStore(310): Store=2a960486aff1fc768be04749de29033f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:24,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,342 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a960486aff1fc768be04749de29033f 2023-07-19 00:10:24,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:24,352 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a960486aff1fc768be04749de29033f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72526108, jitterRate=0.08072322607040405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:24,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a960486aff1fc768be04749de29033f: 2023-07-19 00:10:24,354 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f., pid=6, masterSystemTime=1689725424315 2023-07-19 00:10:24,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:24,361 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:10:24,365 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2a960486aff1fc768be04749de29033f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:24,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689725424364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725424364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725424364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725424364"}]},"ts":"1689725424364"} 2023-07-19 00:10:24,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 00:10:24,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2a960486aff1fc768be04749de29033f, server=jenkins-hbase4.apache.org,36575,1689725420902 in 213 msec 2023-07-19 00:10:24,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 00:10:24,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2a960486aff1fc768be04749de29033f, ASSIGN in 397 msec 2023-07-19 00:10:24,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:24,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725424382"}]},"ts":"1689725424382"} 2023-07-19 00:10:24,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 00:10:24,388 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:24,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 646 msec 2023-07-19 00:10:24,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 00:10:24,469 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,469 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:24,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:24,494 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:24,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 00:10:24,533 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-19 00:10:24,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 00:10:24,572 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 00:10:24,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 24 msec 2023-07-19 00:10:24,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 00:10:24,597 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 00:10:24,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.573sec 2023-07-19 00:10:24,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 00:10:24,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 00:10:24,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 00:10:24,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35857,1689725419330-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 00:10:24,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35857,1689725419330-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 00:10:24,621 DEBUG [Listener at localhost/46673] zookeeper.ReadOnlyZKClient(139): Connect 0x2d81a277 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:24,627 DEBUG [Listener at localhost/46673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8c14a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:24,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:24,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 00:10:24,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:24,641 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:24,645 DEBUG [hconnection-0x12de3cfe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:24,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 00:10:24,647 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:24,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae empty. 2023-07-19 00:10:24,650 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:24,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 00:10:24,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:24,663 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:24,665 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/test.cache.data in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop.log.dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 00:10:24,666 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 00:10:24,667 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/nfs.dump.dir in system properties and HBase conf 2023-07-19 00:10:24,668 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir in system properties and HBase conf 2023-07-19 00:10:24,668 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 00:10:24,668 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 00:10:24,668 INFO [Listener at localhost/46673] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 00:10:24,698 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:24,703 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9ac842ce638f7866b81da1d9042315ae, NAME => 'hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:24,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:24,823 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:24,823 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9ac842ce638f7866b81da1d9042315ae, disabling compactions & flushes 2023-07-19 00:10:24,823 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:24,823 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:24,824 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. after waiting 0 ms 2023-07-19 00:10:24,824 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:24,824 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:24,824 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9ac842ce638f7866b81da1d9042315ae: 2023-07-19 00:10:24,829 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:24,832 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725424831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725424831"}]},"ts":"1689725424831"} 2023-07-19 00:10:24,846 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 00:10:24,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:24,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725424849"}]},"ts":"1689725424849"} 2023-07-19 00:10:24,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 00:10:24,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:24,872 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:24,872 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:24,872 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:24,872 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:24,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9ac842ce638f7866b81da1d9042315ae, ASSIGN}] 2023-07-19 00:10:24,879 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9ac842ce638f7866b81da1d9042315ae, ASSIGN 2023-07-19 00:10:24,881 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9ac842ce638f7866b81da1d9042315ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:10:24,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,031 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:10:25,032 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9ac842ce638f7866b81da1d9042315ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:25,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725425032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725425032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725425032"}]},"ts":"1689725425032"} 2023-07-19 00:10:25,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9ac842ce638f7866b81da1d9042315ae, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:10:25,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:25,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ac842ce638f7866b81da1d9042315ae, NAME => 'hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:10:25,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. service=AccessControlService 2023-07-19 00:10:25,202 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:25,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:25,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,204 INFO [StoreOpener-9ac842ce638f7866b81da1d9042315ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,207 DEBUG [StoreOpener-9ac842ce638f7866b81da1d9042315ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/l 2023-07-19 00:10:25,207 DEBUG [StoreOpener-9ac842ce638f7866b81da1d9042315ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/l 2023-07-19 00:10:25,207 INFO [StoreOpener-9ac842ce638f7866b81da1d9042315ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ac842ce638f7866b81da1d9042315ae columnFamilyName l 2023-07-19 00:10:25,208 INFO [StoreOpener-9ac842ce638f7866b81da1d9042315ae-1] regionserver.HStore(310): Store=9ac842ce638f7866b81da1d9042315ae/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:25,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:10:25,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:25,226 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ac842ce638f7866b81da1d9042315ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67602587, jitterRate=0.007357046008110046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:25,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ac842ce638f7866b81da1d9042315ae: 2023-07-19 00:10:25,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae., pid=11, masterSystemTime=1689725425193 2023-07-19 00:10:25,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:25,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:10:25,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9ac842ce638f7866b81da1d9042315ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:25,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689725425239"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725425239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725425239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725425239"}]},"ts":"1689725425239"} 2023-07-19 00:10:25,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 00:10:25,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9ac842ce638f7866b81da1d9042315ae, server=jenkins-hbase4.apache.org,33821,1689725420836 in 206 msec 2023-07-19 00:10:25,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 00:10:25,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9ac842ce638f7866b81da1d9042315ae, ASSIGN in 389 msec 2023-07-19 00:10:25,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:25,267 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725425267"}]},"ts":"1689725425267"} 2023-07-19 00:10:25,270 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 00:10:25,275 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:25,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 640 msec 2023-07-19 00:10:25,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 00:10:25,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 00:10:25,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 00:10:26,036 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:26,356 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:26,361 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34059_jobhistory____.ti43es/webapp 2023-07-19 00:10:26,516 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 00:10:26,516 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:26,516 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:26,519 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:26,587 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:26,870 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:27,208 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 00:10:27,282 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34059 2023-07-19 00:10:27,540 WARN [Listener at jenkins-hbase4.apache.org/41637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:28,040 WARN [Listener at jenkins-hbase4.apache.org/41637] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:28,041 INFO [Listener at jenkins-hbase4.apache.org/41637] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:28,054 INFO [Listener at jenkins-hbase4.apache.org/41637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40551_cluster____.q22pzl/webapp 2023-07-19 00:10:28,160 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:28,161 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 00:10:28,161 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:28,162 INFO [Listener at jenkins-hbase4.apache.org/41637] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:28,179 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,402 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,688 INFO [Listener at jenkins-hbase4.apache.org/41637] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:28,720 INFO [Listener at jenkins-hbase4.apache.org/41637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40551 2023-07-19 00:10:29,142 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:29,278 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 00:10:29,280 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 00:10:29,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 00:10:29,509 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,510 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 00:10:29,511 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,511 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 00:10:29,511 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 00:10:29,511 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 00:10:29,511 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:29,511 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 00:10:29,512 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 00:10:29,512 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 00:10:29,623 WARN [Listener at jenkins-hbase4.apache.org/33419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:29,655 WARN [Listener at jenkins-hbase4.apache.org/33419] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:29,655 INFO [Listener at jenkins-hbase4.apache.org/33419] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:29,663 INFO [Listener at jenkins-hbase4.apache.org/33419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39629_node____.rrrdnv/webapp 2023-07-19 00:10:29,727 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 00:10:29,728 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:29,728 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:29,728 INFO [Listener at jenkins-hbase4.apache.org/33419] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:29,742 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,769 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,873 INFO [Listener at jenkins-hbase4.apache.org/33419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:29,887 INFO [Listener at jenkins-hbase4.apache.org/33419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39629 2023-07-19 00:10:30,173 WARN [Listener at jenkins-hbase4.apache.org/36577] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 00:10:30,180 WARN [Listener at jenkins-hbase4.apache.org/36577] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 00:10:30,181 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 00:10:30,188 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32929_node____a6x6m7/webapp 2023-07-19 00:10:30,253 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 00:10:30,253 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 00:10:30,253 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 00:10:30,253 INFO [Listener at jenkins-hbase4.apache.org/36577] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 00:10:30,264 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,284 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,364 INFO [Listener at jenkins-hbase4.apache.org/36577] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 00:10:30,370 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32929 2023-07-19 00:10:30,419 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 00:10:30,421 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:30,498 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=176, AvailableMemoryMB=4474 2023-07-19 00:10:30,498 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-19 00:10:30,512 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 00:10:30,517 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 00:10:30,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:30,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:30,531 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:30,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 00:10:30,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:30,538 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:30,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:30,540 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a empty. 2023-07-19 00:10:30,540 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 empty. 2023-07-19 00:10:30,543 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:30,546 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:30,549 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 00:10:30,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:30,983 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:30,985 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc0b79c9bb2d2d3d8bddd9013d89518a, NAME => 'testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:30,985 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => efc4e4019ea815ab6ddc17146327ae54, NAME => 'testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:31,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,020 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing cc0b79c9bb2d2d3d8bddd9013d89518a, disabling compactions & flushes 2023-07-19 00:10:31,020 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,020 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing efc4e4019ea815ab6ddc17146327ae54, disabling compactions & flushes 2023-07-19 00:10:31,021 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. after waiting 0 ms 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. after waiting 0 ms 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,021 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,021 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for efc4e4019ea815ab6ddc17146327ae54: 2023-07-19 00:10:31,021 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for cc0b79c9bb2d2d3d8bddd9013d89518a: 2023-07-19 00:10:31,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:31,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725431027"}]},"ts":"1689725431027"} 2023-07-19 00:10:31,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725431027"}]},"ts":"1689725431027"} 2023-07-19 00:10:31,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:10:31,082 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:31,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725431083"}]},"ts":"1689725431083"} 2023-07-19 00:10:31,086 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 00:10:31,091 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:31,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:31,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:31,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:31,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:31,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, ASSIGN}] 2023-07-19 00:10:31,098 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, ASSIGN 2023-07-19 00:10:31,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, ASSIGN 2023-07-19 00:10:31,099 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:10:31,099 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36575,1689725420902; forceNewPlan=false, retain=false 2023-07-19 00:10:31,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:31,250 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:10:31,253 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=efc4e4019ea815ab6ddc17146327ae54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cc0b79c9bb2d2d3d8bddd9013d89518a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,253 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725431253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725431253"}]},"ts":"1689725431253"} 2023-07-19 00:10:31,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725431253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725431253"}]},"ts":"1689725431253"} 2023-07-19 00:10:31,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure efc4e4019ea815ab6ddc17146327ae54, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:10:31,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure cc0b79c9bb2d2d3d8bddd9013d89518a, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:10:31,412 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,413 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:10:31,414 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:10:31,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => efc4e4019ea815ab6ddc17146327ae54, NAME => 'testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:10:31,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. service=AccessControlService 2023-07-19 00:10:31,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:31,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc0b79c9bb2d2d3d8bddd9013d89518a, NAME => 'testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:10:31,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. service=AccessControlService 2023-07-19 00:10:31,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:31,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:31,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,424 INFO [StoreOpener-efc4e4019ea815ab6ddc17146327ae54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,426 INFO [StoreOpener-cc0b79c9bb2d2d3d8bddd9013d89518a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,427 DEBUG [StoreOpener-efc4e4019ea815ab6ddc17146327ae54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf 2023-07-19 00:10:31,427 DEBUG [StoreOpener-efc4e4019ea815ab6ddc17146327ae54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf 2023-07-19 00:10:31,428 INFO [StoreOpener-efc4e4019ea815ab6ddc17146327ae54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efc4e4019ea815ab6ddc17146327ae54 columnFamilyName cf 2023-07-19 00:10:31,428 DEBUG [StoreOpener-cc0b79c9bb2d2d3d8bddd9013d89518a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf 2023-07-19 00:10:31,428 DEBUG [StoreOpener-cc0b79c9bb2d2d3d8bddd9013d89518a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf 2023-07-19 00:10:31,428 INFO [StoreOpener-cc0b79c9bb2d2d3d8bddd9013d89518a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc0b79c9bb2d2d3d8bddd9013d89518a columnFamilyName cf 2023-07-19 00:10:31,429 INFO [StoreOpener-efc4e4019ea815ab6ddc17146327ae54-1] regionserver.HStore(310): Store=efc4e4019ea815ab6ddc17146327ae54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:31,431 INFO [StoreOpener-cc0b79c9bb2d2d3d8bddd9013d89518a-1] regionserver.HStore(310): Store=cc0b79c9bb2d2d3d8bddd9013d89518a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:31,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:31,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:31,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:31,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:31,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened efc4e4019ea815ab6ddc17146327ae54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69232927, jitterRate=0.031651005148887634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:31,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for efc4e4019ea815ab6ddc17146327ae54: 2023-07-19 00:10:31,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc0b79c9bb2d2d3d8bddd9013d89518a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70166983, jitterRate=0.0455695241689682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:31,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc0b79c9bb2d2d3d8bddd9013d89518a: 2023-07-19 00:10:31,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54., pid=15, masterSystemTime=1689725431409 2023-07-19 00:10:31,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a., pid=16, masterSystemTime=1689725431412 2023-07-19 00:10:31,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,451 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=efc4e4019ea815ab6ddc17146327ae54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,452 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431451"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725431451"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725431451"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725431451"}]},"ts":"1689725431451"} 2023-07-19 00:10:31,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cc0b79c9bb2d2d3d8bddd9013d89518a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725431454"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725431454"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725431454"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725431454"}]},"ts":"1689725431454"} 2023-07-19 00:10:31,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 00:10:31,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure efc4e4019ea815ab6ddc17146327ae54, server=jenkins-hbase4.apache.org,36575,1689725420902 in 204 msec 2023-07-19 00:10:31,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 00:10:31,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure cc0b79c9bb2d2d3d8bddd9013d89518a, server=jenkins-hbase4.apache.org,42753,1689725420945 in 204 msec 2023-07-19 00:10:31,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, ASSIGN in 372 msec 2023-07-19 00:10:31,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-19 00:10:31,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, ASSIGN in 373 msec 2023-07-19 00:10:31,473 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:31,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725431473"}]},"ts":"1689725431473"} 2023-07-19 00:10:31,475 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 00:10:31,479 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:31,484 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 00:10:31,499 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:31,530 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,530 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,530 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,530 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:31,531 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:10:31,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:31,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:31,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:31,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0160 sec 2023-07-19 00:10:31,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 00:10:31,641 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 00:10:31,641 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 00:10:31,642 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:31,647 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 00:10:31,647 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:31,647 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 00:10:31,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725431662 (current time:1689725431662). 2023-07-19 00:10:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x42a9a3d7 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:31,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f2f45ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:31,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:31,672 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:31,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a9a3d7 to 127.0.0.1:55216 2023-07-19 00:10:31,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:31,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x6a0a2a23 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:31,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bf984f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:31,687 DEBUG [hconnection-0x16acbb69-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:31,690 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:31,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a0a2a23 to 127.0.0.1:55216 2023-07-19 00:10:31,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:31,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:31,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:31,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,746 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,747 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689726031747 2023-07-19 00:10:31,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:31,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 00:10:31,751 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:31,756 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:31,756 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:31,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:31,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-19 00:10:31,759 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:31,762 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689726031762 2023-07-19 00:10:31,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,804 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 00:10:31,804 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,806 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 00:10:31,806 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 00:10:31,806 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,806 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,811 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,811 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,812 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,812 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,812 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,813 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,813 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,814 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:31,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,819 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,827 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,827 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,827 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,828 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cc3a39[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:31,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cc3a39[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:31,838 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 00:10:31,838 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,841 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,841 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,842 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,842 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:31,842 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,842 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,843 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:31,843 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:31,842 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:10:31,848 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:31,848 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:31,848 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,848 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:31,848 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:31,849 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:31,850 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:31,850 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:31,850 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,850 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. started... 2023-07-19 00:10:31,850 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. started... 2023-07-19 00:10:31,855 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for efc4e4019ea815ab6ddc17146327ae54: 2023-07-19 00:10:31,855 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0b79c9bb2d2d3d8bddd9013d89518a: 2023-07-19 00:10:31,856 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,856 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:31,857 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:31,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:31,861 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:31,862 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:31,862 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:31,867 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:31,867 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:31,907 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. completed. 2023-07-19 00:10:31,907 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:10:31,913 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,916 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. completed. 2023-07-19 00:10:31,916 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:31,916 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:31,916 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:31,916 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,917 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:31,917 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:10:31,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,918 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:31,918 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:31,918 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,920 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:10:31,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 00:10:31,929 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 00:10:31,929 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:31,929 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:31,929 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,929 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:31,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,933 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:31,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,935 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:31,936 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,940 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,940 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,941 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,958 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:31,959 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:31,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,959 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:31,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:31,960 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,961 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:31,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:31,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,062 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,064 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:10:32,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 00:10:32,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,099 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:32,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689725431749Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689725431960 (+211 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689725431960Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689725431973 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689725432005 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689725432098 (+93 ms) 2023-07-19 00:10:32,101 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 351 msec 2023-07-19 00:10:32,364 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:32,385 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,385 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,389 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,390 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36575] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:32,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:32,397 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 00:10:32,398 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:32,400 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:32,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725432429 (current time:1689725432429). 2023-07-19 00:10:32,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:32,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x386c57fb to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:32,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c5feb98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:32,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,438 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x386c57fb to 127.0.0.1:55216 2023-07-19 00:10:32,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:32,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x2af46c0f to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:32,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@707d2525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:32,447 DEBUG [hconnection-0x33bd1399-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:32,450 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:32,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2af46c0f to 127.0.0.1:55216 2023-07-19 00:10:32,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:32,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 00:10:32,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:32,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,460 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,462 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689726032462 2023-07-19 00:10:32,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 00:10:32,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 00:10:32,463 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:32,464 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:32,465 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 00:10:32,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-19 00:10:32,467 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,468 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689726032468 2023-07-19 00:10:32,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 00:10:32,506 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 00:10:32,506 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,508 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 00:10:32,508 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 00:10:32,509 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,509 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,512 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,512 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,513 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,513 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,514 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,514 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 00:10:32,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:32,515 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:32,515 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:32,516 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:32,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 00:10:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 00:10:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:32,519 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 00:10:32,520 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 00:10:32,520 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 00:10:32,521 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,523 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,523 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,523 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,523 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,523 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,523 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a6e0a8[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 00:10:32,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a6e0a8[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:32,539 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 00:10:32,540 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,545 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:32,545 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:32,545 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,545 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:32,545 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:32,546 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:32,546 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:32,546 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:32,545 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:32,546 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. started... 2023-07-19 00:10:32,546 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,546 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:32,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,546 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. started... 2023-07-19 00:10:32,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,546 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc0b79c9bb2d2d3d8bddd9013d89518a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 00:10:32,546 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2745): Flushing efc4e4019ea815ab6ddc17146327ae54 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 00:10:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,547 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 00:10:32,547 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:32,547 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:10:32,550 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:32,550 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,550 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:32,565 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,568 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:32,642 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/.tmp/cf/269870fa49a94f7ebc2eb6c0b31fff85 2023-07-19 00:10:32,642 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/.tmp/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa 2023-07-19 00:10:32,694 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/.tmp/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa 2023-07-19 00:10:32,694 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/.tmp/cf/269870fa49a94f7ebc2eb6c0b31fff85 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85 2023-07-19 00:10:32,703 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 00:10:32,703 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 00:10:32,709 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for efc4e4019ea815ab6ddc17146327ae54 in 163ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:32,709 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for cc0b79c9bb2d2d3d8bddd9013d89518a in 162ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:32,709 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 00:10:32,709 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc0b79c9bb2d2d3d8bddd9013d89518a: 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for efc4e4019ea815ab6ddc17146327ae54: 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa] hfiles 2023-07-19 00:10:32,711 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85] hfiles 2023-07-19 00:10:32,712 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:32,712 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa for snapshot=snaptb0-testExportWithTargetName 2023-07-19 00:10:32,731 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. completed. 2023-07-19 00:10:32,731 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:10:32,732 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. completed. 2023-07-19 00:10:32,732 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:32,732 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 00:10:32,733 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:10:32,734 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:32,734 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,734 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,734 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,736 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 00:10:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 00:10:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:10:32,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 00:10:32,746 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 00:10:32,746 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:32,746 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:32,746 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 00:10:32,746 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:32,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,750 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,751 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:32,751 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:32,754 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 00:10:32,755 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,756 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:32,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,767 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:32,769 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:32,768 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,767 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:32,769 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,769 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:32,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,769 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,770 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:32,770 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:32,770 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:32,770 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:32,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:32,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:32,771 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:10:32,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,836 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 00:10:32,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,837 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 00:10:32,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689725432462Consolidate snapshot: snaptb0-testExportWithTargetName at 1689725432767 (+305 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689725432767Writing data manifest for snaptb0-testExportWithTargetName at 1689725432774 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689725432787 (+13 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689725432836 (+49 ms) 2023-07-19 00:10:32,838 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 00:10:32,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 375 msec 2023-07-19 00:10:33,071 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 00:10:33,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:33,075 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075 2023-07-19 00:10:33,075 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39213, tgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075, rawTgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:33,124 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:33,124 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-196178149_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 00:10:33,124 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 00:10:33,154 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 00:10:33,272 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,273 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,274 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,274 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,275 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,276 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,276 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,370 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-6529866377927673017.jar 2023-07-19 00:10:33,370 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,371 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,371 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,373 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:33,373 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:10:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:10:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:10:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:10:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:10:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:10:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:10:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:10:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:10:33,378 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:10:33,381 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:33,382 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:33,382 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:33,382 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:33,383 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:33,383 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:33,383 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:34,242 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:10:34,248 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 00:10:34,259 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 00:10:34,683 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:34,685 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:35,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:36,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:40,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:42,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:45,522 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:47,107 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:10:47,117 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:10:47,149 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 00:10:47,149 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:10:47,150 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:10:47,150 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 00:10:47,152 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 00:10:47,152 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 00:10:47,152 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/testExportWithTargetName 2023-07-19 00:10:47,154 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 00:10:47,154 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725433075/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 00:10:47,168 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 00:10:47,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 00:10:47,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725447192"}]},"ts":"1689725447192"} 2023-07-19 00:10:47,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:47,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 00:10:47,196 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 00:10:47,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, UNASSIGN}] 2023-07-19 00:10:47,201 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, UNASSIGN 2023-07-19 00:10:47,201 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, UNASSIGN 2023-07-19 00:10:47,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=efc4e4019ea815ab6ddc17146327ae54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:47,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cc0b79c9bb2d2d3d8bddd9013d89518a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:47,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725447202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725447202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725447202"}]},"ts":"1689725447202"} 2023-07-19 00:10:47,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725447202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725447202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725447202"}]},"ts":"1689725447202"} 2023-07-19 00:10:47,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure efc4e4019ea815ab6ddc17146327ae54, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:10:47,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure cc0b79c9bb2d2d3d8bddd9013d89518a, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:10:47,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:47,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:47,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:47,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing efc4e4019ea815ab6ddc17146327ae54, disabling compactions & flushes 2023-07-19 00:10:47,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc0b79c9bb2d2d3d8bddd9013d89518a, disabling compactions & flushes 2023-07-19 00:10:47,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:47,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:47,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:47,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:47,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. after waiting 0 ms 2023-07-19 00:10:47,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. after waiting 0 ms 2023-07-19 00:10:47,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:47,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:47,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:10:47,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:10:47,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:47,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:10:47,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54. 2023-07-19 00:10:47,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a. 2023-07-19 00:10:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for efc4e4019ea815ab6ddc17146327ae54: 2023-07-19 00:10:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc0b79c9bb2d2d3d8bddd9013d89518a: 2023-07-19 00:10:47,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:47,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:47,401 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=cc0b79c9bb2d2d3d8bddd9013d89518a, regionState=CLOSED 2023-07-19 00:10:47,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725447401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725447401"}]},"ts":"1689725447401"} 2023-07-19 00:10:47,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=efc4e4019ea815ab6ddc17146327ae54, regionState=CLOSED 2023-07-19 00:10:47,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689725447403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725447403"}]},"ts":"1689725447403"} 2023-07-19 00:10:47,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-19 00:10:47,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure cc0b79c9bb2d2d3d8bddd9013d89518a, server=jenkins-hbase4.apache.org,42753,1689725420945 in 199 msec 2023-07-19 00:10:47,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-19 00:10:47,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure efc4e4019ea815ab6ddc17146327ae54, server=jenkins-hbase4.apache.org,36575,1689725420902 in 202 msec 2023-07-19 00:10:47,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cc0b79c9bb2d2d3d8bddd9013d89518a, UNASSIGN in 211 msec 2023-07-19 00:10:47,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 00:10:47,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=efc4e4019ea815ab6ddc17146327ae54, UNASSIGN in 216 msec 2023-07-19 00:10:47,421 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725447421"}]},"ts":"1689725447421"} 2023-07-19 00:10:47,423 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 00:10:47,428 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 00:10:47,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 252 msec 2023-07-19 00:10:47,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 00:10:47,496 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 00:10:47,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 00:10:47,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,519 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 00:10:47,531 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:47,532 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:47,534 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 00:10:47,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/recovered.edits] 2023-07-19 00:10:47,537 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/recovered.edits] 2023-07-19 00:10:47,537 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,537 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,537 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 00:10:47,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 00:10:47,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:47,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:47,540 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:47,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:47,540 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:47,542 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 00:10:47,543 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:47,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 00:10:47,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 00:10:47,544 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:10:47,548 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/cf/b97ac8229d9a442f8bf7f3a2d1cf72fa 2023-07-19 00:10:47,548 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/cf/269870fa49a94f7ebc2eb6c0b31fff85 2023-07-19 00:10:47,553 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54/recovered.edits/9.seqid 2023-07-19 00:10:47,553 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a/recovered.edits/9.seqid 2023-07-19 00:10:47,554 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/efc4e4019ea815ab6ddc17146327ae54 2023-07-19 00:10:47,554 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportWithTargetName/cc0b79c9bb2d2d3d8bddd9013d89518a 2023-07-19 00:10:47,554 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 00:10:47,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,580 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 00:10:47,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 00:10:47,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 00:10:47,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725447585"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:47,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725447585"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:47,588 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:10:47,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => efc4e4019ea815ab6ddc17146327ae54, NAME => 'testtb-testExportWithTargetName,,1689725430525.efc4e4019ea815ab6ddc17146327ae54.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc0b79c9bb2d2d3d8bddd9013d89518a, NAME => 'testtb-testExportWithTargetName,1,1689725430525.cc0b79c9bb2d2d3d8bddd9013d89518a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:10:47,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 00:10:47,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725447589"}]},"ts":"9223372036854775807"} 2023-07-19 00:10:47,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 00:10:47,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 00:10:47,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-07-19 00:10:47,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 00:10:47,646 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 00:10:47,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 00:10:47,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 00:10:47,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 00:10:47,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 00:10:47,711 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 709) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:32918 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:42965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1593174066_1 at /127.0.0.1:38250 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:57150 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1593174066_1 at /127.0.0.1:57138 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:38276 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:40227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2363 (was 4474) 2023-07-19 00:10:47,712 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 00:10:47,736 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=186, AvailableMemoryMB=2321 2023-07-19 00:10:47,737 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 00:10:47,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:10:47,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:10:47,745 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:10:47,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 00:10:47,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:47,747 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:10:47,750 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:47,751 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed empty. 2023-07-19 00:10:47,751 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:47,752 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:47,752 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 empty. 2023-07-19 00:10:47,753 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:47,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 00:10:47,779 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 00:10:47,781 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f564a7f7644536849e749dd47d4664a5, NAME => 'testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:47,781 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a35366dc072b1a959d9e464d70679ed, NAME => 'testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:10:47,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:47,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f564a7f7644536849e749dd47d4664a5, disabling compactions & flushes 2023-07-19 00:10:47,820 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:47,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:47,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:47,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3a35366dc072b1a959d9e464d70679ed, disabling compactions & flushes 2023-07-19 00:10:47,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. after waiting 0 ms 2023-07-19 00:10:47,821 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:47,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:47,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:47,822 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:47,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. after waiting 0 ms 2023-07-19 00:10:47,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f564a7f7644536849e749dd47d4664a5: 2023-07-19 00:10:47,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:47,822 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:47,822 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3a35366dc072b1a959d9e464d70679ed: 2023-07-19 00:10:47,825 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:10:47,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725447826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725447826"}]},"ts":"1689725447826"} 2023-07-19 00:10:47,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725447826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725447826"}]},"ts":"1689725447826"} 2023-07-19 00:10:47,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:10:47,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:10:47,830 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725447830"}]},"ts":"1689725447830"} 2023-07-19 00:10:47,833 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 00:10:47,836 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:10:47,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:10:47,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:10:47,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:10:47,838 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:10:47,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, ASSIGN}] 2023-07-19 00:10:47,841 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, ASSIGN 2023-07-19 00:10:47,841 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, ASSIGN 2023-07-19 00:10:47,843 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:10:47,843 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36575,1689725420902; forceNewPlan=false, retain=false 2023-07-19 00:10:47,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:47,993 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:10:47,996 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f564a7f7644536849e749dd47d4664a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:47,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3a35366dc072b1a959d9e464d70679ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:47,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725447996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725447996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725447996"}]},"ts":"1689725447996"} 2023-07-19 00:10:47,997 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725447996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725447996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725447996"}]},"ts":"1689725447996"} 2023-07-19 00:10:47,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure f564a7f7644536849e749dd47d4664a5, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:10:48,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 3a35366dc072b1a959d9e464d70679ed, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:10:48,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:48,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a35366dc072b1a959d9e464d70679ed, NAME => 'testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:10:48,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. service=AccessControlService 2023-07-19 00:10:48,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:48,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:48,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,170 INFO [StoreOpener-3a35366dc072b1a959d9e464d70679ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,174 DEBUG [StoreOpener-3a35366dc072b1a959d9e464d70679ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf 2023-07-19 00:10:48,174 DEBUG [StoreOpener-3a35366dc072b1a959d9e464d70679ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf 2023-07-19 00:10:48,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f564a7f7644536849e749dd47d4664a5, NAME => 'testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:10:48,175 INFO [StoreOpener-3a35366dc072b1a959d9e464d70679ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a35366dc072b1a959d9e464d70679ed columnFamilyName cf 2023-07-19 00:10:48,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. service=AccessControlService 2023-07-19 00:10:48,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:10:48,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,176 INFO [StoreOpener-3a35366dc072b1a959d9e464d70679ed-1] regionserver.HStore(310): Store=3a35366dc072b1a959d9e464d70679ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:48,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:10:48,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,178 INFO [StoreOpener-f564a7f7644536849e749dd47d4664a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,180 DEBUG [StoreOpener-f564a7f7644536849e749dd47d4664a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf 2023-07-19 00:10:48,180 DEBUG [StoreOpener-f564a7f7644536849e749dd47d4664a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf 2023-07-19 00:10:48,181 INFO [StoreOpener-f564a7f7644536849e749dd47d4664a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f564a7f7644536849e749dd47d4664a5 columnFamilyName cf 2023-07-19 00:10:48,181 INFO [StoreOpener-f564a7f7644536849e749dd47d4664a5-1] regionserver.HStore(310): Store=f564a7f7644536849e749dd47d4664a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:10:48,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:10:48,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:48,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a35366dc072b1a959d9e464d70679ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74897401, jitterRate=0.11605824530124664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:48,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a35366dc072b1a959d9e464d70679ed: 2023-07-19 00:10:48,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed., pid=31, masterSystemTime=1689725448160 2023-07-19 00:10:48,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f564a7f7644536849e749dd47d4664a5 2023-07-19 00:10:48,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,195 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3a35366dc072b1a959d9e464d70679ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,195 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725448195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725448195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725448195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725448195"}]},"ts":"1689725448195"} 2023-07-19 00:10:48,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:10:48,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f564a7f7644536849e749dd47d4664a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64247923, jitterRate=-0.04263134300708771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:10:48,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f564a7f7644536849e749dd47d4664a5: 2023-07-19 00:10:48,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5., pid=30, masterSystemTime=1689725448158 2023-07-19 00:10:48,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 00:10:48,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 3a35366dc072b1a959d9e464d70679ed, server=jenkins-hbase4.apache.org,36575,1689725420902 in 190 msec 2023-07-19 00:10:48,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f564a7f7644536849e749dd47d4664a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725448203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725448203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725448203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725448203"}]},"ts":"1689725448203"} 2023-07-19 00:10:48,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, ASSIGN in 365 msec 2023-07-19 00:10:48,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 00:10:48,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure f564a7f7644536849e749dd47d4664a5, server=jenkins-hbase4.apache.org,33821,1689725420836 in 206 msec 2023-07-19 00:10:48,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 00:10:48,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, ASSIGN in 371 msec 2023-07-19 00:10:48,213 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:10:48,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725448213"}]},"ts":"1689725448213"} 2023-07-19 00:10:48,215 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 00:10:48,217 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:10:48,217 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 00:10:48,219 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:48,221 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:48,221 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:48,221 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:48,221 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:10:48,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:48,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:48,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:48,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:10:48,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 483 msec 2023-07-19 00:10:48,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 00:10:48,350 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 00:10:48,350 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 00:10:48,351 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:48,354 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 00:10:48,354 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:48,354 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 00:10:48,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725448357 (current time:1689725448357). 2023-07-19 00:10:48,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:48,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x1994b769 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:48,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7edf941a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:48,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:48,369 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1994b769 to 127.0.0.1:55216 2023-07-19 00:10:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x0e1b4edd to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32089f88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:48,377 DEBUG [hconnection-0x3075a297-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:48,378 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:48,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e1b4edd to 127.0.0.1:55216 2023-07-19 00:10:48,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:48,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:48,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,387 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,388 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726048388 2023-07-19 00:10:48,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 00:10:48,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,389 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:48,389 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:48,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,391 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 00:10:48,394 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,395 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726048395 2023-07-19 00:10:48,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,435 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 00:10:48,435 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,437 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 00:10:48,437 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:10:48,438 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,438 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,440 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,440 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,441 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,441 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,442 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,442 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:48,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,444 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,445 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,446 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,446 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 00:10:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,448 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,448 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,449 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,449 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,449 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,449 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,449 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,450 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,450 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,455 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:48,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f2ff18a[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:48,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f2ff18a[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:48,462 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:10:48,463 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,464 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,464 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:48,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,464 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:10:48,465 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,465 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:48,464 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,465 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,465 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. started... 2023-07-19 00:10:48,465 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. started... 2023-07-19 00:10:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a35366dc072b1a959d9e464d70679ed: 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f564a7f7644536849e749dd47d4664a5: 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:48,467 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,483 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. completed. 2023-07-19 00:10:48,483 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,486 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:48,486 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:48,486 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:10:48,487 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. completed. 2023-07-19 00:10:48,487 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:10:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,488 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,490 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:48,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:48,491 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:48,492 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,492 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,492 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,492 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:10:48,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:10:48,501 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 00:10:48,501 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:48,501 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:48,501 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,502 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:48,505 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,505 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,505 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,505 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,505 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,506 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,507 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,507 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,509 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,511 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,511 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,512 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,518 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,518 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,517 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,519 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,519 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,519 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,519 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,520 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,520 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,520 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 00:10:48,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 00:10:48,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689725448388Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689725448519 (+131 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689725448520 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689725448524 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689725448540 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689725448570 (+30 ms) 2023-07-19 00:10:48,573 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 185 msec 2023-07-19 00:10:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:48,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:48,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:48,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:48,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33821] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:10:48,710 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 00:10:48,710 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,710 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:10:48,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725448723 (current time:1689725448723). 2023-07-19 00:10:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:10:48,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x0e80a248 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:48,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6475520, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:48,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:48,734 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:48,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e80a248 to 127.0.0.1:55216 2023-07-19 00:10:48,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:48,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x619d9dfe to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:10:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56564742, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:10:48,744 DEBUG [hconnection-0xf6c2b5b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:10:48,747 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:10:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x619d9dfe to 127.0.0.1:55216 2023-07-19 00:10:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:10:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:10:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:10:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,755 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,757 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726048757 2023-07-19 00:10:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:10:48,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 00:10:48,758 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:10:48,758 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:10:48,759 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:10:48,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 00:10:48,762 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,763 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726048763 2023-07-19 00:10:48,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 00:10:48,787 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 00:10:48,787 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,789 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 00:10:48,789 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:10:48,789 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,789 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,791 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,791 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,791 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,791 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,791 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,791 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,792 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,792 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 00:10:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 00:10:48,796 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,796 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,796 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 00:10:48,796 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:10:48,796 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,797 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 00:10:48,797 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 00:10:48,797 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 00:10:48,800 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,800 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,801 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,802 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:10:48,802 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2945f2d6[Count = 1] remaining members to acquire global barrier 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 00:10:48,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2945f2d6[Count = 0] remaining members to acquire global barrier 2023-07-19 00:10:48,808 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:10:48,808 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,809 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,809 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,809 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:10:48,810 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,810 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,810 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:10:48,810 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:10:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,813 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,813 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:48,816 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:10:48,816 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:48,816 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. started... 2023-07-19 00:10:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:10:48,816 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. started... 2023-07-19 00:10:48,817 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a35366dc072b1a959d9e464d70679ed 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 00:10:48,817 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f564a7f7644536849e749dd47d4664a5 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 00:10:48,858 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:48,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:48,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:10:48,860 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:10:48,864 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/.tmp/cf/30371671d8424199b3419e7cf83112fd 2023-07-19 00:10:48,869 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/.tmp/cf/ee2b179457664d29971683bcb198ee6e 2023-07-19 00:10:48,878 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/.tmp/cf/30371671d8424199b3419e7cf83112fd as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd 2023-07-19 00:10:48,881 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/.tmp/cf/ee2b179457664d29971683bcb198ee6e as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e 2023-07-19 00:10:48,887 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd, entries=6, sequenceid=6, filesize=5.2 K 2023-07-19 00:10:48,890 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 3a35366dc072b1a959d9e464d70679ed in 73ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:48,890 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 00:10:48,890 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e, entries=44, sequenceid=6, filesize=7.8 K 2023-07-19 00:10:48,894 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a35366dc072b1a959d9e464d70679ed: 2023-07-19 00:10:48,894 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:48,894 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:48,894 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd] hfiles 2023-07-19 00:10:48,894 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:48,894 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for f564a7f7644536849e749dd47d4664a5 in 77ms, sequenceid=6, compaction requested=false 2023-07-19 00:10:48,896 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f564a7f7644536849e749dd47d4664a5: 2023-07-19 00:10:48,896 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:48,896 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:10:48,896 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e] hfiles 2023-07-19 00:10:48,896 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e for snapshot=snaptb0-testExportFileSystemState 2023-07-19 00:10:48,914 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. completed. 2023-07-19 00:10:48,915 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:10:48,915 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:48,915 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:48,915 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,917 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,918 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:10:48,922 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,922 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. completed. 2023-07-19 00:10:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,922 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:10:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:10:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:10:48,922 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 00:10:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:10:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,926 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 00:10:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 00:10:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:10:48,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:10:48,934 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 00:10:48,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:10:48,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:10:48,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 00:10:48,934 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,936 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,937 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:10:48,937 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,939 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,940 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:10:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 00:10:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,943 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,943 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,944 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,946 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,946 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,946 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:10:48,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 00:10:48,947 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:10:48,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 00:10:48,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:10:48,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:10:48,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:10:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:10:48,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:10:48,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 00:10:48,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,993 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:48,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689725448757Consolidate snapshot: snaptb0-testExportFileSystemState at 1689725448947 (+190 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689725448949 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689725448953 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689725448962 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689725448992 (+30 ms) 2023-07-19 00:10:48,996 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 00:10:48,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 238 msec 2023-07-19 00:10:49,060 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:10:49,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:10:49,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:10:49,062 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061 2023-07-19 00:10:49,062 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39213, tgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061, rawTgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:49,086 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:10:49,086 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1186116054_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:49,086 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 00:10:49,099 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 00:10:49,130 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,131 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,131 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,131 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,132 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,132 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,132 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,206 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-6680839513260642626.jar 2023-07-19 00:10:49,206 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:10:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:10:49,209 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:10:49,209 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:10:49,209 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:10:49,210 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:10:49,210 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:10:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:10:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:10:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:10:49,212 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:10:49,212 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:49,213 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:49,213 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:49,213 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:49,214 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:10:49,214 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:49,214 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:10:50,106 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:10:50,109 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 00:10:50,111 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 00:10:51,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:51,732 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:10:51,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0001_000001 (auth:SIMPLE) 2023-07-19 00:10:52,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0002_000001 (auth:SIMPLE) 2023-07-19 00:10:52,988 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:10:57,056 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0002_000001 (auth:SIMPLE) 2023-07-19 00:10:59,429 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:02,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:03,406 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:03,407 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:03,415 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 00:11:03,415 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:03,416 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:03,416 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:11:03,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 00:11:03,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 00:11:03,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 00:11:03,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 00:11:03,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725449061/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 00:11:03,426 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 00:11:03,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 00:11:03,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:03,431 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725463431"}]},"ts":"1689725463431"} 2023-07-19 00:11:03,433 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 00:11:03,434 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 00:11:03,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, UNASSIGN}] 2023-07-19 00:11:03,438 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, UNASSIGN 2023-07-19 00:11:03,438 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, UNASSIGN 2023-07-19 00:11:03,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3a35366dc072b1a959d9e464d70679ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:03,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725463439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725463439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725463439"}]},"ts":"1689725463439"} 2023-07-19 00:11:03,439 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f564a7f7644536849e749dd47d4664a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:03,439 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725463439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725463439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725463439"}]},"ts":"1689725463439"} 2023-07-19 00:11:03,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 3a35366dc072b1a959d9e464d70679ed, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:11:03,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure f564a7f7644536849e749dd47d4664a5, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:03,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:03,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a35366dc072b1a959d9e464d70679ed, disabling compactions & flushes 2023-07-19 00:11:03,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f564a7f7644536849e749dd47d4664a5 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f564a7f7644536849e749dd47d4664a5, disabling compactions & flushes 2023-07-19 00:11:03,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:11:03,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. after waiting 0 ms 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. after waiting 0 ms 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:11:03,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:11:03,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:03,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:03,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:03,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:03,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5. 2023-07-19 00:11:03,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed. 2023-07-19 00:11:03,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f564a7f7644536849e749dd47d4664a5: 2023-07-19 00:11:03,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a35366dc072b1a959d9e464d70679ed: 2023-07-19 00:11:03,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:11:03,623 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3a35366dc072b1a959d9e464d70679ed, regionState=CLOSED 2023-07-19 00:11:03,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725463623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725463623"}]},"ts":"1689725463623"} 2023-07-19 00:11:03,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f564a7f7644536849e749dd47d4664a5 2023-07-19 00:11:03,625 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f564a7f7644536849e749dd47d4664a5, regionState=CLOSED 2023-07-19 00:11:03,625 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689725463625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725463625"}]},"ts":"1689725463625"} 2023-07-19 00:11:03,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 00:11:03,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 3a35366dc072b1a959d9e464d70679ed, server=jenkins-hbase4.apache.org,36575,1689725420902 in 185 msec 2023-07-19 00:11:03,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 00:11:03,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure f564a7f7644536849e749dd47d4664a5, server=jenkins-hbase4.apache.org,33821,1689725420836 in 185 msec 2023-07-19 00:11:03,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a35366dc072b1a959d9e464d70679ed, UNASSIGN in 194 msec 2023-07-19 00:11:03,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 00:11:03,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f564a7f7644536849e749dd47d4664a5, UNASSIGN in 195 msec 2023-07-19 00:11:03,633 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725463633"}]},"ts":"1689725463633"} 2023-07-19 00:11:03,634 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 00:11:03,636 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 00:11:03,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-19 00:11:03,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 00:11:03,734 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 00:11:03,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 00:11:03,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 00:11:03,740 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,741 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 00:11:03,746 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:11:03,749 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:11:03,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,749 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:03,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:03,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:03,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 00:11:03,751 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/recovered.edits] 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:03,751 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 00:11:03,752 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:03,752 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/recovered.edits] 2023-07-19 00:11:03,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 00:11:03,762 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/cf/30371671d8424199b3419e7cf83112fd 2023-07-19 00:11:03,762 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/cf/ee2b179457664d29971683bcb198ee6e 2023-07-19 00:11:03,765 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed/recovered.edits/9.seqid 2023-07-19 00:11:03,766 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5/recovered.edits/9.seqid 2023-07-19 00:11:03,766 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/3a35366dc072b1a959d9e464d70679ed 2023-07-19 00:11:03,767 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemState/f564a7f7644536849e749dd47d4664a5 2023-07-19 00:11:03,767 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 00:11:03,770 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,775 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 00:11:03,777 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 00:11:03,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 00:11:03,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725463779"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:03,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725463779"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:03,781 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:11:03,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3a35366dc072b1a959d9e464d70679ed, NAME => 'testtb-testExportFileSystemState,,1689725447739.3a35366dc072b1a959d9e464d70679ed.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f564a7f7644536849e749dd47d4664a5, NAME => 'testtb-testExportFileSystemState,1,1689725447739.f564a7f7644536849e749dd47d4664a5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:11:03,781 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 00:11:03,781 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725463781"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:03,783 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 00:11:03,786 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 00:11:03,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-07-19 00:11:03,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 00:11:03,855 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 00:11:03,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 00:11:03,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 00:11:03,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 00:11:03,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 00:11:03,900 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 756) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:36577 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:34225 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:60650 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:53006 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2136333634_1 at /127.0.0.1:52990 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:52148 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=396 (was 370) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 186), AvailableMemoryMB=2436 (was 2321) - AvailableMemoryMB LEAK? - 2023-07-19 00:11:03,900 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 00:11:03,924 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=186, AvailableMemoryMB=2435 2023-07-19 00:11:03,924 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-19 00:11:03,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:11:03,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:03,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:03,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 00:11:03,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:03,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:03,938 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:03,938 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:03,939 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 empty. 2023-07-19 00:11:03,939 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 empty. 2023-07-19 00:11:03,939 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:03,940 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:03,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 00:11:03,958 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:03,959 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => cef374018d31d1d8010e9d23273cef76, NAME => 'testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:03,959 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 65ffeb897822e70af5e3ef80fd00c6d7, NAME => 'testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:04,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:04,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing cef374018d31d1d8010e9d23273cef76, disabling compactions & flushes 2023-07-19 00:11:04,006 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. after waiting 0 ms 2023-07-19 00:11:04,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,007 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,007 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for cef374018d31d1d8010e9d23273cef76: 2023-07-19 00:11:04,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:04,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 65ffeb897822e70af5e3ef80fd00c6d7, disabling compactions & flushes 2023-07-19 00:11:04,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. after waiting 0 ms 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 65ffeb897822e70af5e3ef80fd00c6d7: 2023-07-19 00:11:04,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:04,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725464405"}]},"ts":"1689725464405"} 2023-07-19 00:11:04,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725464405"}]},"ts":"1689725464405"} 2023-07-19 00:11:04,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:04,409 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:04,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725464409"}]},"ts":"1689725464409"} 2023-07-19 00:11:04,411 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 00:11:04,415 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:04,417 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:04,417 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:04,417 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:04,417 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:04,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, ASSIGN}] 2023-07-19 00:11:04,420 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, ASSIGN 2023-07-19 00:11:04,420 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, ASSIGN 2023-07-19 00:11:04,421 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:11:04,421 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:11:04,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:04,571 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:04,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cef374018d31d1d8010e9d23273cef76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:04,577 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=65ffeb897822e70af5e3ef80fd00c6d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:04,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725464577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725464577"}]},"ts":"1689725464577"} 2023-07-19 00:11:04,578 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725464577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725464577"}]},"ts":"1689725464577"} 2023-07-19 00:11:04,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure cef374018d31d1d8010e9d23273cef76, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:04,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 65ffeb897822e70af5e3ef80fd00c6d7, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:04,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cef374018d31d1d8010e9d23273cef76, NAME => 'testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65ffeb897822e70af5e3ef80fd00c6d7, NAME => 'testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. service=AccessControlService 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. service=AccessControlService 2023-07-19 00:11:04,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:04,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,750 INFO [StoreOpener-65ffeb897822e70af5e3ef80fd00c6d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,750 INFO [StoreOpener-cef374018d31d1d8010e9d23273cef76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,752 DEBUG [StoreOpener-cef374018d31d1d8010e9d23273cef76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf 2023-07-19 00:11:04,752 DEBUG [StoreOpener-cef374018d31d1d8010e9d23273cef76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf 2023-07-19 00:11:04,752 DEBUG [StoreOpener-65ffeb897822e70af5e3ef80fd00c6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf 2023-07-19 00:11:04,753 DEBUG [StoreOpener-65ffeb897822e70af5e3ef80fd00c6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf 2023-07-19 00:11:04,753 INFO [StoreOpener-cef374018d31d1d8010e9d23273cef76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cef374018d31d1d8010e9d23273cef76 columnFamilyName cf 2023-07-19 00:11:04,753 INFO [StoreOpener-65ffeb897822e70af5e3ef80fd00c6d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ffeb897822e70af5e3ef80fd00c6d7 columnFamilyName cf 2023-07-19 00:11:04,754 INFO [StoreOpener-cef374018d31d1d8010e9d23273cef76-1] regionserver.HStore(310): Store=cef374018d31d1d8010e9d23273cef76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:04,754 INFO [StoreOpener-65ffeb897822e70af5e3ef80fd00c6d7-1] regionserver.HStore(310): Store=65ffeb897822e70af5e3ef80fd00c6d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:04,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:04,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:04,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cef374018d31d1d8010e9d23273cef76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62741464, jitterRate=-0.06507933139801025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:04,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cef374018d31d1d8010e9d23273cef76: 2023-07-19 00:11:04,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76., pid=45, masterSystemTime=1689725464732 2023-07-19 00:11:04,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:04,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cef374018d31d1d8010e9d23273cef76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:04,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725464768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725464768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725464768"}]},"ts":"1689725464768"} 2023-07-19 00:11:04,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:04,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 00:11:04,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure cef374018d31d1d8010e9d23273cef76, server=jenkins-hbase4.apache.org,42753,1689725420945 in 190 msec 2023-07-19 00:11:04,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:04,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65ffeb897822e70af5e3ef80fd00c6d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64579912, jitterRate=-0.03768432140350342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:04,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65ffeb897822e70af5e3ef80fd00c6d7: 2023-07-19 00:11:04,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, ASSIGN in 356 msec 2023-07-19 00:11:04,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7., pid=46, masterSystemTime=1689725464733 2023-07-19 00:11:04,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:04,778 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=65ffeb897822e70af5e3ef80fd00c6d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:04,778 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725464778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725464778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725464778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725464778"}]},"ts":"1689725464778"} 2023-07-19 00:11:04,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 00:11:04,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 65ffeb897822e70af5e3ef80fd00c6d7, server=jenkins-hbase4.apache.org,33821,1689725420836 in 199 msec 2023-07-19 00:11:04,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 00:11:04,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, ASSIGN in 370 msec 2023-07-19 00:11:04,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:04,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725464793"}]},"ts":"1689725464793"} 2023-07-19 00:11:04,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 00:11:04,800 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:04,800 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 00:11:04,803 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:04,805 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:04,805 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:04,805 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:04,805 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:04,807 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:04,807 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:04,808 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:04,808 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:04,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 881 msec 2023-07-19 00:11:05,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 00:11:05,043 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 00:11:05,043 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 00:11:05,043 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:05,051 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 00:11:05,051 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:05,051 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 00:11:05,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725465055 (current time:1689725465055). 2023-07-19 00:11:05,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:05,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x233312dd to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:05,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b213dc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:05,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:05,067 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:05,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x233312dd to 127.0.0.1:55216 2023-07-19 00:11:05,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:05,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x07548b85 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:05,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ccac448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:05,089 DEBUG [hconnection-0x2e97696d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:05,093 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:05,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07548b85 to 127.0.0.1:55216 2023-07-19 00:11:05,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:05,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,105 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,106 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689726065106 2023-07-19 00:11:05,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 00:11:05,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,108 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:05,108 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:05,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,119 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 17 msec 2023-07-19 00:11:05,122 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,123 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689726065123 2023-07-19 00:11:05,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,142 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 00:11:05,142 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 00:11:05,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 00:11:05,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,147 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,147 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,147 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,147 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,148 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,148 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,149 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,149 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,151 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,151 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,151 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,153 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,157 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,158 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,158 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,158 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,159 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,159 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,159 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,160 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4e1835[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:05,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4e1835[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:05,166 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 00:11:05,166 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:05,168 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,169 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,169 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,169 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,169 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:05,170 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:05,170 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. started... 2023-07-19 00:11:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:05,170 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:05,170 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. started... 2023-07-19 00:11:05,172 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65ffeb897822e70af5e3ef80fd00c6d7: 2023-07-19 00:11:05,175 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cef374018d31d1d8010e9d23273cef76: 2023-07-19 00:11:05,175 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,175 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:05,175 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:05,175 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,176 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:05,176 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:05,176 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,176 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,176 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,186 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. completed. 2023-07-19 00:11:05,186 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:05,186 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,188 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,188 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,190 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. completed. 2023-07-19 00:11:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,190 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,190 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,192 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,192 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:11:05,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 00:11:05,200 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 00:11:05,200 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:05,200 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:05,200 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,200 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,202 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,203 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,205 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,206 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,207 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,207 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,208 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,208 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:05,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:05,210 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,212 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,212 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,214 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,214 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,214 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,214 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,215 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 00:11:05,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,262 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:05,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689725465106Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689725465214 (+108 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689725465214Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689725465218 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689725465228 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689725465261 (+33 ms) 2023-07-19 00:11:05,264 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 156 msec 2023-07-19 00:11:05,284 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 00:11:05,410 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:05,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:05,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:05,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:05,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33821] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:05,424 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 00:11:05,424 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:05,426 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:05,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725465442 (current time:1689725465442). 2023-07-19 00:11:05,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:05,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x3b7f0411 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:05,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a4c13e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:05,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:05,460 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:05,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b7f0411 to 127.0.0.1:55216 2023-07-19 00:11:05,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:05,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x1d70f64a to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:05,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eec3679, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:05,469 DEBUG [hconnection-0x3e21a1ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:05,470 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:05,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d70f64a to 127.0.0.1:55216 2023-07-19 00:11:05,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:05,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 00:11:05,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:05,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,479 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,480 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689726065480 2023-07-19 00:11:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 00:11:05,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 00:11:05,482 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:05,482 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:05,483 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 00:11:05,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 00:11:05,485 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689726065486 2023-07-19 00:11:05,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 00:11:05,496 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 00:11:05,496 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,497 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 00:11:05,497 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 00:11:05,498 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,498 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,499 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,499 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,499 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,499 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,500 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,500 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,500 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,500 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:05,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 00:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 00:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 00:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,505 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,505 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 00:11:05,505 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 00:11:05,505 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 00:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,507 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,507 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,508 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,508 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,508 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,508 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d31cd4[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 00:11:05,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d31cd4[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:05,512 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 00:11:05,512 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,513 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,513 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,514 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 00:11:05,514 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. started... 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:05,514 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:05,515 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:05,515 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cef374018d31d1d8010e9d23273cef76 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-19 00:11:05,515 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. started... 2023-07-19 00:11:05,515 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 65ffeb897822e70af5e3ef80fd00c6d7 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-19 00:11:05,515 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,518 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,518 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,518 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:05,518 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,518 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,539 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/.tmp/cf/4fb5e05f60f34c93bfee6f92c7d29963 2023-07-19 00:11:05,539 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/.tmp/cf/e4eab6b7efc64e08aeafe1b5d083ee98 2023-07-19 00:11:05,548 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/.tmp/cf/4fb5e05f60f34c93bfee6f92c7d29963 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963 2023-07-19 00:11:05,550 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/.tmp/cf/e4eab6b7efc64e08aeafe1b5d083ee98 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98 2023-07-19 00:11:05,554 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963, entries=7, sequenceid=6, filesize=5.3 K 2023-07-19 00:11:05,555 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98, entries=43, sequenceid=6, filesize=7.7 K 2023-07-19 00:11:05,556 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for cef374018d31d1d8010e9d23273cef76 in 42ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cef374018d31d1d8010e9d23273cef76: 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963] hfiles 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:05,558 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 65ffeb897822e70af5e3ef80fd00c6d7 in 43ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65ffeb897822e70af5e3ef80fd00c6d7: 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98] hfiles 2023-07-19 00:11:05,558 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 00:11:05,577 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. completed. 2023-07-19 00:11:05,577 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:05,579 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. completed. 2023-07-19 00:11:05,579 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 00:11:05,579 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,580 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,582 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:05,582 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 00:11:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 00:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:05,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,585 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:11:05,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 00:11:05,591 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 00:11:05,591 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:05,591 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:05,591 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 00:11:05,591 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:05,594 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,594 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,595 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,596 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,598 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:05,598 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 00:11:05,598 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:05,605 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,605 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 00:11:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:05,607 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,608 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:05,608 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:05,608 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,608 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:05,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 00:11:05,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,650 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689725465480Consolidate snapshot: snaptb0-testConsecutiveExports at 1689725465607 (+127 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689725465607Writing data manifest for snaptb0-testConsecutiveExports at 1689725465611 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689725465623 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689725465649 (+26 ms) 2023-07-19 00:11:05,653 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 00:11:05,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 171 msec 2023-07-19 00:11:05,785 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:05,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 00:11:05,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:05,787 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786 2023-07-19 00:11:05,787 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:05,809 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:05,810 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@53df5299, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,810 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 00:11:05,817 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:05,830 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,831 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,832 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,832 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,833 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,833 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,834 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,907 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-914487094372459178.jar 2023-07-19 00:11:05,908 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,908 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,909 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,909 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,910 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,910 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:05,911 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:05,911 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:05,912 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:05,913 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:05,913 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:05,914 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:05,914 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:05,915 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:05,915 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:05,916 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:05,917 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:05,917 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:05,920 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:06,374 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:06,380 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 00:11:06,386 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 00:11:08,315 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:08,315 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:08,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0002_000001 (auth:SIMPLE) 2023-07-19 00:11:08,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:09,195 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:11:12,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:15,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:18,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:19,616 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:19,616 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:19,620 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 00:11:19,620 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:19,621 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:19,621 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:19,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:19,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:19,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@355c60fa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:19,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:19,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:19,623 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@11caad52, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:19,649 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 00:11:19,661 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 00:11:19,675 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,675 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,675 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,676 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,676 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,676 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,677 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,764 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-5120839594725498142.jar 2023-07-19 00:11:19,765 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,765 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,766 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,766 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,766 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,767 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:19,767 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:19,767 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:19,768 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:19,768 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:19,769 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:19,769 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:19,770 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:19,771 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:19,771 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:19,772 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:19,772 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:19,773 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:19,773 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:19,773 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:19,773 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:19,774 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:19,774 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:21,132 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:21,137 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 00:11:21,139 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 00:11:24,459 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:24,459 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:24,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0003_000001 (auth:SIMPLE) 2023-07-19 00:11:25,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:29,182 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:31,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:34,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:35,428 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:35,428 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:35,436 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 00:11:35,436 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:35,437 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:35,437 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:35,441 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:35,441 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:35,441 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@355c60fa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 00:11:35,442 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 00:11:35,442 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/local-export-1689725465786/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 00:11:35,459 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 00:11:35,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 00:11:35,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725495470"}]},"ts":"1689725495470"} 2023-07-19 00:11:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:35,473 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 00:11:35,481 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 00:11:35,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, UNASSIGN}] 2023-07-19 00:11:35,483 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, UNASSIGN 2023-07-19 00:11:35,485 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, UNASSIGN 2023-07-19 00:11:35,486 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=65ffeb897822e70af5e3ef80fd00c6d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:35,486 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cef374018d31d1d8010e9d23273cef76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:35,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725495486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725495486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725495486"}]},"ts":"1689725495486"} 2023-07-19 00:11:35,486 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725495486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725495486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725495486"}]},"ts":"1689725495486"} 2023-07-19 00:11:35,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 65ffeb897822e70af5e3ef80fd00c6d7, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:35,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure cef374018d31d1d8010e9d23273cef76, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:35,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:35,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:35,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65ffeb897822e70af5e3ef80fd00c6d7, disabling compactions & flushes 2023-07-19 00:11:35,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:35,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:35,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. after waiting 0 ms 2023-07-19 00:11:35,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:35,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:35,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cef374018d31d1d8010e9d23273cef76, disabling compactions & flushes 2023-07-19 00:11:35,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:35,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:35,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. after waiting 0 ms 2023-07-19 00:11:35,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:35,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:35,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:35,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:35,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76. 2023-07-19 00:11:35,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cef374018d31d1d8010e9d23273cef76: 2023-07-19 00:11:35,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:35,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7. 2023-07-19 00:11:35,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65ffeb897822e70af5e3ef80fd00c6d7: 2023-07-19 00:11:35,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:35,698 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cef374018d31d1d8010e9d23273cef76, regionState=CLOSED 2023-07-19 00:11:35,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:35,698 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725495698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725495698"}]},"ts":"1689725495698"} 2023-07-19 00:11:35,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=65ffeb897822e70af5e3ef80fd00c6d7, regionState=CLOSED 2023-07-19 00:11:35,699 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689725495699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725495699"}]},"ts":"1689725495699"} 2023-07-19 00:11:35,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 00:11:35,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure cef374018d31d1d8010e9d23273cef76, server=jenkins-hbase4.apache.org,42753,1689725420945 in 183 msec 2023-07-19 00:11:35,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 00:11:35,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 65ffeb897822e70af5e3ef80fd00c6d7, server=jenkins-hbase4.apache.org,33821,1689725420836 in 213 msec 2023-07-19 00:11:35,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cef374018d31d1d8010e9d23273cef76, UNASSIGN in 223 msec 2023-07-19 00:11:35,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 00:11:35,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ffeb897822e70af5e3ef80fd00c6d7, UNASSIGN in 224 msec 2023-07-19 00:11:35,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725495710"}]},"ts":"1689725495710"} 2023-07-19 00:11:35,711 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 00:11:35,713 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 00:11:35,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 254 msec 2023-07-19 00:11:35,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 00:11:35,774 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 00:11:35,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 00:11:35,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 00:11:35,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,784 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 00:11:35,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:35,787 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:35,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:35,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:35,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 00:11:35,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,790 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/recovered.edits] 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:35,790 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/recovered.edits] 2023-07-19 00:11:35,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 00:11:35,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:35,795 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/cf/e4eab6b7efc64e08aeafe1b5d083ee98 2023-07-19 00:11:35,795 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/cf/4fb5e05f60f34c93bfee6f92c7d29963 2023-07-19 00:11:35,799 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7/recovered.edits/9.seqid 2023-07-19 00:11:35,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76/recovered.edits/9.seqid 2023-07-19 00:11:35,800 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/65ffeb897822e70af5e3ef80fd00c6d7 2023-07-19 00:11:35,800 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testConsecutiveExports/cef374018d31d1d8010e9d23273cef76 2023-07-19 00:11:35,800 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 00:11:35,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,805 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 00:11:35,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 00:11:35,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 00:11:35,808 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725495808"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:35,808 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725495808"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:35,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:11:35,810 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cef374018d31d1d8010e9d23273cef76, NAME => 'testtb-testConsecutiveExports,,1689725463926.cef374018d31d1d8010e9d23273cef76.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 65ffeb897822e70af5e3ef80fd00c6d7, NAME => 'testtb-testConsecutiveExports,1,1689725463926.65ffeb897822e70af5e3ef80fd00c6d7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:11:35,810 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 00:11:35,810 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725495810"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:35,812 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 00:11:35,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 00:11:35,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 39 msec 2023-07-19 00:11:35,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 00:11:35,894 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 00:11:35,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 00:11:35,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 00:11:35,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 00:11:35,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 00:11:35,944 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 768), OpenFileDescriptor=899 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=521 (was 396) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 186), AvailableMemoryMB=2018 (was 2435) 2023-07-19 00:11:35,944 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 00:11:35,967 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=521, ProcessCount=186, AvailableMemoryMB=2012 2023-07-19 00:11:35,967 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-19 00:11:35,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:11:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:35,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:35,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 00:11:35,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:35,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:35,982 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:35,982 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:35,982 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d empty. 2023-07-19 00:11:35,982 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e empty. 2023-07-19 00:11:35,983 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:35,983 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:35,983 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 00:11:36,000 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:36,001 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2637c2775dc44e7e0ac8b994a21c36d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:36,002 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c2025967ebedfcfa047845be939e2d2e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:36,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:36,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing a2637c2775dc44e7e0ac8b994a21c36d, disabling compactions & flushes 2023-07-19 00:11:36,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. after waiting 0 ms 2023-07-19 00:11:36,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for a2637c2775dc44e7e0ac8b994a21c36d: 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c2025967ebedfcfa047845be939e2d2e, disabling compactions & flushes 2023-07-19 00:11:36,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. after waiting 0 ms 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c2025967ebedfcfa047845be939e2d2e: 2023-07-19 00:11:36,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:36,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725496031"}]},"ts":"1689725496031"} 2023-07-19 00:11:36,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725496031"}]},"ts":"1689725496031"} 2023-07-19 00:11:36,037 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:36,038 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:36,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725496038"}]},"ts":"1689725496038"} 2023-07-19 00:11:36,040 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 00:11:36,043 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:36,045 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:36,045 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:36,045 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:36,045 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:36,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, ASSIGN}] 2023-07-19 00:11:36,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, ASSIGN 2023-07-19 00:11:36,048 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, ASSIGN 2023-07-19 00:11:36,049 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:11:36,049 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:11:36,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:36,199 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:36,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c2025967ebedfcfa047845be939e2d2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,201 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a2637c2775dc44e7e0ac8b994a21c36d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725496201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725496201"}]},"ts":"1689725496201"} 2023-07-19 00:11:36,202 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725496201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725496201"}]},"ts":"1689725496201"} 2023-07-19 00:11:36,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure c2025967ebedfcfa047845be939e2d2e, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:36,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure a2637c2775dc44e7e0ac8b994a21c36d, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:36,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:36,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2025967ebedfcfa047845be939e2d2e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. service=AccessControlService 2023-07-19 00:11:36,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2637c2775dc44e7e0ac8b994a21c36d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. service=AccessControlService 2023-07-19 00:11:36,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:36,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:36,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,363 INFO [StoreOpener-c2025967ebedfcfa047845be939e2d2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,363 INFO [StoreOpener-a2637c2775dc44e7e0ac8b994a21c36d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,365 DEBUG [StoreOpener-c2025967ebedfcfa047845be939e2d2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf 2023-07-19 00:11:36,365 DEBUG [StoreOpener-a2637c2775dc44e7e0ac8b994a21c36d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf 2023-07-19 00:11:36,365 DEBUG [StoreOpener-c2025967ebedfcfa047845be939e2d2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf 2023-07-19 00:11:36,365 DEBUG [StoreOpener-a2637c2775dc44e7e0ac8b994a21c36d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf 2023-07-19 00:11:36,367 INFO [StoreOpener-c2025967ebedfcfa047845be939e2d2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2025967ebedfcfa047845be939e2d2e columnFamilyName cf 2023-07-19 00:11:36,367 INFO [StoreOpener-a2637c2775dc44e7e0ac8b994a21c36d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2637c2775dc44e7e0ac8b994a21c36d columnFamilyName cf 2023-07-19 00:11:36,368 INFO [StoreOpener-c2025967ebedfcfa047845be939e2d2e-1] regionserver.HStore(310): Store=c2025967ebedfcfa047845be939e2d2e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:36,368 INFO [StoreOpener-a2637c2775dc44e7e0ac8b994a21c36d-1] regionserver.HStore(310): Store=a2637c2775dc44e7e0ac8b994a21c36d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:36,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:36,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:36,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:36,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2637c2775dc44e7e0ac8b994a21c36d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64160021, jitterRate=-0.043941184878349304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:36,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2025967ebedfcfa047845be939e2d2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67280397, jitterRate=0.00255604088306427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:36,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2637c2775dc44e7e0ac8b994a21c36d: 2023-07-19 00:11:36,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2025967ebedfcfa047845be939e2d2e: 2023-07-19 00:11:36,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e., pid=60, masterSystemTime=1689725496355 2023-07-19 00:11:36,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d., pid=61, masterSystemTime=1689725496357 2023-07-19 00:11:36,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c2025967ebedfcfa047845be939e2d2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,382 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725496382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725496382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725496382"}]},"ts":"1689725496382"} 2023-07-19 00:11:36,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,383 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a2637c2775dc44e7e0ac8b994a21c36d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,383 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725496383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725496383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725496383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725496383"}]},"ts":"1689725496383"} 2023-07-19 00:11:36,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-19 00:11:36,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure c2025967ebedfcfa047845be939e2d2e, server=jenkins-hbase4.apache.org,33821,1689725420836 in 180 msec 2023-07-19 00:11:36,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-19 00:11:36,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure a2637c2775dc44e7e0ac8b994a21c36d, server=jenkins-hbase4.apache.org,42753,1689725420945 in 180 msec 2023-07-19 00:11:36,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, ASSIGN in 342 msec 2023-07-19 00:11:36,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 00:11:36,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, ASSIGN in 343 msec 2023-07-19 00:11:36,391 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:36,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725496391"}]},"ts":"1689725496391"} 2023-07-19 00:11:36,393 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 00:11:36,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:36,396 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 00:11:36,398 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:36,399 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:36,399 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:36,399 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:36,399 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:36,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:36,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 432 msec 2023-07-19 00:11:36,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 00:11:36,578 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 00:11:36,578 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 00:11:36,579 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:36,583 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 00:11:36,583 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:36,583 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 00:11:36,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:36,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725496589 (current time:1689725496589). 2023-07-19 00:11:36,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:36,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x4ce47db1 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58897319, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:36,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:36,606 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:36,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ce47db1 to 127.0.0.1:55216 2023-07-19 00:11:36,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:36,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x59b2e36b to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:36,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36540419, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:36,625 DEBUG [hconnection-0x2556a871-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:36,630 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b2e36b to 127.0.0.1:55216 2023-07-19 00:11:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:36,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:36,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:36,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:36,642 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:36,643 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689726096643 2023-07-19 00:11:36,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:36,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:36,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:36,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:36,655 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:36,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-19 00:11:36,664 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:36,665 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689726096665 2023-07-19 00:11:36,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,683 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:36,683 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:36,688 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 00:11:36,688 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 00:11:36,689 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,689 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,690 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,690 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,690 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,691 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,691 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,690 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,691 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,691 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:36,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,693 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:36,693 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:36,693 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:36,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,703 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:36,703 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:36,703 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:36,700 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:36,703 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:36,705 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:36,705 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:36,705 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:36,705 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:36,705 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,707 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,707 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,707 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:36,708 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,708 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11601ec5[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:36,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:36,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11601ec5[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:36,711 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 00:11:36,712 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:36,714 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:36,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,714 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:36,714 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,714 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,715 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. started... 2023-07-19 00:11:36,715 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:36,715 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:36,716 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,716 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2025967ebedfcfa047845be939e2d2e: 2023-07-19 00:11:36,716 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. started... 2023-07-19 00:11:36,716 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:36,717 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,717 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:36,717 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:36,721 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2637c2775dc44e7e0ac8b994a21c36d: 2023-07-19 00:11:36,722 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,722 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:36,722 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. completed. 2023-07-19 00:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:36,737 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,745 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:36,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:36,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:36,747 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,750 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. completed. 2023-07-19 00:11:36,750 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:36,750 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,752 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:11:36,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 00:11:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:36,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:36,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 00:11:36,771 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 00:11:36,772 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:36,772 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:36,772 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,772 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:36,774 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,774 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,774 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:36,774 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,774 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:36,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,776 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:36,777 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,778 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:36,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,781 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,781 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,782 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,786 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,786 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:36,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:36,787 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:36,787 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:36,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,788 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:36,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:36,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:36,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:36,790 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:36,947 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:36,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:36,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:36,949 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:11:37,249 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:37,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:37,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:37,250 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:11:37,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 00:11:37,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,283 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689725496643Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725496787 (+144 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725496787Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725496796 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689725496843 (+47 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689725497283 (+440 ms) 2023-07-19 00:11:37,287 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:37,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 642 msec 2023-07-19 00:11:37,750 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:37,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:37,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:37,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:37,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33821] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:37,763 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,764 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:37,764 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:37,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:37,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725497778 (current time:1689725497778). 2023-07-19 00:11:37,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:37,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x70875ff2 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:37,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@762d788d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:37,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:37,788 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:37,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70875ff2 to 127.0.0.1:55216 2023-07-19 00:11:37,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:37,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x757c5a68 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fcef3fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:37,797 DEBUG [hconnection-0x223a0d9e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:37,799 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x757c5a68 to 127.0.0.1:55216 2023-07-19 00:11:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 00:11:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:37,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:37,808 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:37,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689726097809 2023-07-19 00:11:37,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 00:11:37,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,811 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:37,811 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:37,812 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 00:11:37,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:37,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 00:11:37,814 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:37,815 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689726097814 2023-07-19 00:11:37,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,831 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:37,831 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:37,833 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 00:11:37,833 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 00:11:37,833 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,834 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,835 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,835 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,838 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,839 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,843 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,843 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,844 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:37,844 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:37,844 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,844 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:37,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,844 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:37,844 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:37,844 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:37,846 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 00:11:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:37,846 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:37,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:37,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 00:11:37,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,851 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 00:11:37,851 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:37,852 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 00:11:37,852 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 00:11:37,852 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 00:11:37,852 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,852 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:37,852 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,852 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,853 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,853 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:37,854 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,854 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:37,854 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:37,854 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,854 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b58d7d[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:37,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 00:11:37,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b58d7d[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:37,858 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 00:11:37,858 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:37,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,860 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:37,860 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 00:11:37,860 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:37,860 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:37,860 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. started... 2023-07-19 00:11:37,860 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. started... 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:37,861 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a2637c2775dc44e7e0ac8b994a21c36d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 00:11:37,860 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:37,861 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2025967ebedfcfa047845be939e2d2e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 00:11:37,868 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:37,868 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:37,868 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:37,887 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/.tmp/cf/20a62663c830474c9ec84c4e13bfe33b 2023-07-19 00:11:37,889 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/.tmp/cf/53c035478fc04ad4ba492902c00988b0 2023-07-19 00:11:37,894 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/.tmp/cf/20a62663c830474c9ec84c4e13bfe33b as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b 2023-07-19 00:11:37,895 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/.tmp/cf/53c035478fc04ad4ba492902c00988b0 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0 2023-07-19 00:11:37,899 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 00:11:37,901 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c2025967ebedfcfa047845be939e2d2e in 39ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:37,901 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 00:11:37,901 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2025967ebedfcfa047845be939e2d2e: 2023-07-19 00:11:37,902 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,902 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:37,902 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b] hfiles 2023-07-19 00:11:37,902 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,902 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 00:11:37,903 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a2637c2775dc44e7e0ac8b994a21c36d in 42ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:37,908 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2637c2775dc44e7e0ac8b994a21c36d: 2023-07-19 00:11:37,908 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,908 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:37,909 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0] hfiles 2023-07-19 00:11:37,909 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,911 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:37,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:37,912 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:37,921 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. completed. 2023-07-19 00:11:37,921 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. completed. 2023-07-19 00:11:37,922 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:37,921 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:37,922 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:37,924 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:37,924 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,924 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 00:11:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:37,925 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:37,925 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,925 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:37,925 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:37,926 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 00:11:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:37,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 00:11:37,934 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 00:11:37,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:37,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:37,934 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,934 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:37,939 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,940 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,939 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,939 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:37,940 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:37,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,941 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,941 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,943 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:37,943 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,943 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,947 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:37,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,947 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:37,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:37,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:37,948 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:37,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:37,949 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:37,950 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,950 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:37,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:37,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 00:11:37,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,988 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:37,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689725497809Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689725497948 (+139 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689725497948Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689725497952 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689725497961 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689725497988 (+27 ms) 2023-07-19 00:11:37,991 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 00:11:37,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 181 msec 2023-07-19 00:11:38,112 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:38,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 00:11:38,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:38,142 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:38,147 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:38,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33821] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:38,149 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:38,153 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:38,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36575] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:38,153 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 00:11:38,155 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 00:11:38,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 00:11:38,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:11:38,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:38,160 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:38,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 00:11:38,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:38,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:38,163 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,163 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,164 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 empty. 2023-07-19 00:11:38,164 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 empty. 2023-07-19 00:11:38,164 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,164 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,164 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 00:11:38,173 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:38,175 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3eac68fa1cbc0846eb7b15ccd0555fd9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:38,175 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7195f2820bb426ea966ee4fb03175957, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 3eac68fa1cbc0846eb7b15ccd0555fd9, disabling compactions & flushes 2023-07-19 00:11:38,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. after waiting 0 ms 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:38,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 7195f2820bb426ea966ee4fb03175957, disabling compactions & flushes 2023-07-19 00:11:38,182 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 3eac68fa1cbc0846eb7b15ccd0555fd9: 2023-07-19 00:11:38,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. after waiting 0 ms 2023-07-19 00:11:38,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 7195f2820bb426ea966ee4fb03175957: 2023-07-19 00:11:38,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:38,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725498185"}]},"ts":"1689725498185"} 2023-07-19 00:11:38,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725498185"}]},"ts":"1689725498185"} 2023-07-19 00:11:38,188 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:38,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:38,189 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725498189"}]},"ts":"1689725498189"} 2023-07-19 00:11:38,190 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 00:11:38,193 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:38,194 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:38,194 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:38,194 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:38,194 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:38,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, ASSIGN}] 2023-07-19 00:11:38,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, ASSIGN 2023-07-19 00:11:38,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, ASSIGN 2023-07-19 00:11:38,198 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:11:38,198 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:11:38,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:38,348 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:38,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7195f2820bb426ea966ee4fb03175957, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:38,351 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3eac68fa1cbc0846eb7b15ccd0555fd9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:38,351 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498351"}]},"ts":"1689725498351"} 2023-07-19 00:11:38,351 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498351"}]},"ts":"1689725498351"} 2023-07-19 00:11:38,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 7195f2820bb426ea966ee4fb03175957, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:38,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 3eac68fa1cbc0846eb7b15ccd0555fd9, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:38,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:38,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7195f2820bb426ea966ee4fb03175957, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 00:11:38,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3eac68fa1cbc0846eb7b15ccd0555fd9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. service=AccessControlService 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. service=AccessControlService 2023-07-19 00:11:38,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:38,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,512 INFO [StoreOpener-3eac68fa1cbc0846eb7b15ccd0555fd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,512 INFO [StoreOpener-7195f2820bb426ea966ee4fb03175957-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,513 DEBUG [StoreOpener-3eac68fa1cbc0846eb7b15ccd0555fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf 2023-07-19 00:11:38,513 DEBUG [StoreOpener-7195f2820bb426ea966ee4fb03175957-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf 2023-07-19 00:11:38,513 DEBUG [StoreOpener-3eac68fa1cbc0846eb7b15ccd0555fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf 2023-07-19 00:11:38,513 DEBUG [StoreOpener-7195f2820bb426ea966ee4fb03175957-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf 2023-07-19 00:11:38,514 INFO [StoreOpener-7195f2820bb426ea966ee4fb03175957-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7195f2820bb426ea966ee4fb03175957 columnFamilyName cf 2023-07-19 00:11:38,514 INFO [StoreOpener-3eac68fa1cbc0846eb7b15ccd0555fd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eac68fa1cbc0846eb7b15ccd0555fd9 columnFamilyName cf 2023-07-19 00:11:38,515 INFO [StoreOpener-7195f2820bb426ea966ee4fb03175957-1] regionserver.HStore(310): Store=7195f2820bb426ea966ee4fb03175957/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:38,515 INFO [StoreOpener-3eac68fa1cbc0846eb7b15ccd0555fd9-1] regionserver.HStore(310): Store=3eac68fa1cbc0846eb7b15ccd0555fd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:38,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:38,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:38,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3eac68fa1cbc0846eb7b15ccd0555fd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64608722, jitterRate=-0.03725501894950867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:38,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7195f2820bb426ea966ee4fb03175957; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61196559, jitterRate=-0.08810020983219147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:38,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3eac68fa1cbc0846eb7b15ccd0555fd9: 2023-07-19 00:11:38,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7195f2820bb426ea966ee4fb03175957: 2023-07-19 00:11:38,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9., pid=70, masterSystemTime=1689725498505 2023-07-19 00:11:38,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957., pid=69, masterSystemTime=1689725498505 2023-07-19 00:11:38,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,524 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3eac68fa1cbc0846eb7b15ccd0555fd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:38,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,525 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725498524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725498524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725498524"}]},"ts":"1689725498524"} 2023-07-19 00:11:38,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,525 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7195f2820bb426ea966ee4fb03175957, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:38,525 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725498525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725498525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725498525"}]},"ts":"1689725498525"} 2023-07-19 00:11:38,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-19 00:11:38,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-19 00:11:38,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 3eac68fa1cbc0846eb7b15ccd0555fd9, server=jenkins-hbase4.apache.org,42753,1689725420945 in 172 msec 2023-07-19 00:11:38,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 7195f2820bb426ea966ee4fb03175957, server=jenkins-hbase4.apache.org,33821,1689725420836 in 174 msec 2023-07-19 00:11:38,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, ASSIGN in 338 msec 2023-07-19 00:11:38,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-19 00:11:38,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, ASSIGN in 338 msec 2023-07-19 00:11:38,535 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:38,535 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725498535"}]},"ts":"1689725498535"} 2023-07-19 00:11:38,536 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 00:11:38,538 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:38,539 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 00:11:38,541 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 00:11:38,542 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,542 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,542 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,542 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:38,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 386 msec 2023-07-19 00:11:38,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 00:11:38,765 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 00:11:38,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957], force=true 2023-07-19 00:11:38,800 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957], force=true 2023-07-19 00:11:38,801 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957], force=true 2023-07-19 00:11:38,801 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957], force=true 2023-07-19 00:11:38,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:38,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, UNASSIGN}] 2023-07-19 00:11:38,833 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, UNASSIGN 2023-07-19 00:11:38,834 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, UNASSIGN 2023-07-19 00:11:38,838 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7195f2820bb426ea966ee4fb03175957, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:38,838 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3eac68fa1cbc0846eb7b15ccd0555fd9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:38,838 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498838"}]},"ts":"1689725498838"} 2023-07-19 00:11:38,839 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725498838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725498838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725498838"}]},"ts":"1689725498838"} 2023-07-19 00:11:38,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 7195f2820bb426ea966ee4fb03175957, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:38,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 3eac68fa1cbc0846eb7b15ccd0555fd9, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:38,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:38,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:38,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:38,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7195f2820bb426ea966ee4fb03175957, disabling compactions & flushes 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3eac68fa1cbc0846eb7b15ccd0555fd9, disabling compactions & flushes 2023-07-19 00:11:38,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. after waiting 0 ms 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:38,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3eac68fa1cbc0846eb7b15ccd0555fd9 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. after waiting 0 ms 2023-07-19 00:11:38,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:38,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7195f2820bb426ea966ee4fb03175957 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 00:11:39,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/.tmp/cf/e8d1ac237f834ba9888c98378ca9db67 2023-07-19 00:11:39,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/.tmp/cf/ba341acf54ae4fa1a67d6bbf6c26c06d 2023-07-19 00:11:39,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/.tmp/cf/e8d1ac237f834ba9888c98378ca9db67 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67 2023-07-19 00:11:39,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/.tmp/cf/ba341acf54ae4fa1a67d6bbf6c26c06d as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d 2023-07-19 00:11:39,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 00:11:39,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 3eac68fa1cbc0846eb7b15ccd0555fd9 in 25ms, sequenceid=5, compaction requested=false 2023-07-19 00:11:39,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 00:11:39,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 00:11:39,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7195f2820bb426ea966ee4fb03175957 in 31ms, sequenceid=5, compaction requested=false 2023-07-19 00:11:39,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 00:11:39,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 00:11:39,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:39,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:39,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9. 2023-07-19 00:11:39,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957. 2023-07-19 00:11:39,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3eac68fa1cbc0846eb7b15ccd0555fd9: 2023-07-19 00:11:39,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7195f2820bb426ea966ee4fb03175957: 2023-07-19 00:11:39,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:39,040 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7195f2820bb426ea966ee4fb03175957, regionState=CLOSED 2023-07-19 00:11:39,040 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725499040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725499040"}]},"ts":"1689725499040"} 2023-07-19 00:11:39,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:39,041 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3eac68fa1cbc0846eb7b15ccd0555fd9, regionState=CLOSED 2023-07-19 00:11:39,041 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689725499041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725499041"}]},"ts":"1689725499041"} 2023-07-19 00:11:39,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 00:11:39,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 7195f2820bb426ea966ee4fb03175957, server=jenkins-hbase4.apache.org,33821,1689725420836 in 200 msec 2023-07-19 00:11:39,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 00:11:39,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 3eac68fa1cbc0846eb7b15ccd0555fd9, server=jenkins-hbase4.apache.org,42753,1689725420945 in 200 msec 2023-07-19 00:11:39,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7195f2820bb426ea966ee4fb03175957, UNASSIGN in 213 msec 2023-07-19 00:11:39,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 00:11:39,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3eac68fa1cbc0846eb7b15ccd0555fd9, UNASSIGN in 218 msec 2023-07-19 00:11:39,109 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 00:11:39,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:39,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498157.3eac68fa1cbc0846eb7b15ccd0555fd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:39,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689725498157.7195f2820bb426ea966ee4fb03175957.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:39,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:39,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, ASSIGN}] 2023-07-19 00:11:39,167 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, ASSIGN 2023-07-19 00:11:39,168 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:11:39,319 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 00:11:39,320 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dbe5257ac083904452aafdb14fde689f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725499320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725499320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725499320"}]},"ts":"1689725499320"} 2023-07-19 00:11:39,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure dbe5257ac083904452aafdb14fde689f, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:39,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:39,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:39,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe5257ac083904452aafdb14fde689f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.', STARTKEY => '', ENDKEY => ''} 2023-07-19 00:11:39,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. service=AccessControlService 2023-07-19 00:11:39,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/.regioninfo 2023-07-19 00:11:39,489 INFO [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,490 DEBUG [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf 2023-07-19 00:11:39,490 DEBUG [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf 2023-07-19 00:11:39,491 INFO [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe5257ac083904452aafdb14fde689f columnFamilyName cf 2023-07-19 00:11:39,518 DEBUG [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] regionserver.HStore(539): loaded hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/ba341acf54ae4fa1a67d6bbf6c26c06d.7195f2820bb426ea966ee4fb03175957->hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d-top 2023-07-19 00:11:39,524 DEBUG [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] regionserver.HStore(539): loaded hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/e8d1ac237f834ba9888c98378ca9db67.3eac68fa1cbc0846eb7b15ccd0555fd9->hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67-top 2023-07-19 00:11:39,525 INFO [StoreOpener-dbe5257ac083904452aafdb14fde689f-1] regionserver.HStore(310): Store=dbe5257ac083904452aafdb14fde689f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:39,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:39,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbe5257ac083904452aafdb14fde689f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67876813, jitterRate=0.011443331837654114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:39,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbe5257ac083904452aafdb14fde689f: 2023-07-19 00:11:39,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f., pid=77, masterSystemTime=1689725499474 2023-07-19 00:11:39,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.,because compaction is disabled. 2023-07-19 00:11:39,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:39,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:39,543 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dbe5257ac083904452aafdb14fde689f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,543 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725499542"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725499542"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725499542"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725499542"}]},"ts":"1689725499542"} 2023-07-19 00:11:39,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 00:11:39,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure dbe5257ac083904452aafdb14fde689f, server=jenkins-hbase4.apache.org,42753,1689725420945 in 222 msec 2023-07-19 00:11:39,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 00:11:39,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, ASSIGN in 381 msec 2023-07-19 00:11:39,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3eac68fa1cbc0846eb7b15ccd0555fd9, 7195f2820bb426ea966ee4fb03175957], force=true in 758 msec 2023-07-19 00:11:39,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 00:11:39,913 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 00:11:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:39,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725499914 (current time:1689725499914). 2023-07-19 00:11:39,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:39,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x1862f4db to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:39,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6597f84a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:39,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:39,925 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:39,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1862f4db to 127.0.0.1:55216 2023-07-19 00:11:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x488e9a46 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:39,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47c57ba0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:39,937 DEBUG [hconnection-0x1dca9eba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:39,941 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x488e9a46 to 127.0.0.1:55216 2023-07-19 00:11:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 00:11:39,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:39,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:39,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:39,951 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:39,952 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689726099952 2023-07-19 00:11:39,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 00:11:39,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,957 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:39,957 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:39,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:39,959 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 00:11:39,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-19 00:11:39,961 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:39,962 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689726099962 2023-07-19 00:11:39,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,975 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 00:11:39,975 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,977 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 00:11:39,977 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 00:11:39,978 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,978 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,979 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,979 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,979 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,979 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:39,980 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,980 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:39,983 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:39,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 00:11:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,986 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 00:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,986 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 00:11:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 00:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 00:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 00:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,990 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,990 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:39,990 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,990 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:39,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 00:11:39,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5875b00e[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:39,993 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 00:11:39,993 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:39,994 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:39,994 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:39,994 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:39,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,994 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:39,994 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:39,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 00:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:39,995 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:39,995 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. started... 2023-07-19 00:11:39,997 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbe5257ac083904452aafdb14fde689f: 2023-07-19 00:11:39,997 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,997 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,997 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/ba341acf54ae4fa1a67d6bbf6c26c06d.7195f2820bb426ea966ee4fb03175957->hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d-top, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/e8d1ac237f834ba9888c98378ca9db67.3eac68fa1cbc0846eb7b15ccd0555fd9->hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67-top] hfiles 2023-07-19 00:11:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:39,998 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/ba341acf54ae4fa1a67d6bbf6c26c06d.7195f2820bb426ea966ee4fb03175957 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:39,999 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:39,999 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:39,999 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:40,002 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/e8d1ac237f834ba9888c98378ca9db67.3eac68fa1cbc0846eb7b15ccd0555fd9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,025 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. completed. 2023-07-19 00:11:40,025 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 00:11:40,025 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:40,029 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,029 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 00:11:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 00:11:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:40,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 00:11:40,035 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 00:11:40,035 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:40,035 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:40,035 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,035 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,037 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,046 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,046 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,047 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,048 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,048 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,049 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:40,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,052 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:40,052 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:40,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:40,057 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:40,059 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:40,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 00:11:40,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,101 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689725499952Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725500052 (+100 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725500052Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725500056 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689725500072 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689725500101 (+29 ms) 2023-07-19 00:11:40,104 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 00:11:40,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 147 msec 2023-07-19 00:11:40,259 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:40,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 00:11:40,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:40,261 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261 2023-07-19 00:11:40,261 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39213, tgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261, rawTgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:40,301 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:40,301 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-126073066_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,301 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 00:11:40,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0004_000001 (auth:SIMPLE) 2023-07-19 00:11:40,315 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:40,344 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,345 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,345 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,345 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,346 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,346 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,346 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,415 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-3207991461245487626.jar 2023-07-19 00:11:40,416 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,416 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,416 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,417 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,418 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:40,418 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:40,418 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:40,419 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:40,419 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:40,419 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:40,420 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:40,420 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:40,421 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:40,421 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:40,421 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:40,422 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:40,422 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:40,422 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:40,870 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:40,873 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 00:11:40,875 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 00:11:40,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:40,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:41,288 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:11:41,302 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:47,202 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:49,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:53,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:55,109 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:11:55,110 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:11:55,137 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,137 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:11:55,138 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:11:55,138 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,138 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 00:11:55,139 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 00:11:55,139 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,139 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 00:11:55,139 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725500261/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 00:11:55,150 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:11:55,156 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725515156"}]},"ts":"1689725515156"} 2023-07-19 00:11:55,158 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 00:11:55,160 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 00:11:55,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, UNASSIGN}] 2023-07-19 00:11:55,163 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, UNASSIGN 2023-07-19 00:11:55,164 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dbe5257ac083904452aafdb14fde689f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:55,164 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725515164"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725515164"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725515164"}]},"ts":"1689725515164"} 2023-07-19 00:11:55,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure dbe5257ac083904452aafdb14fde689f, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:55,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:11:55,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:55,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbe5257ac083904452aafdb14fde689f, disabling compactions & flushes 2023-07-19 00:11:55,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:55,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:55,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. after waiting 0 ms 2023-07-19 00:11:55,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:55,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 00:11:55,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:55,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f. 2023-07-19 00:11:55,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbe5257ac083904452aafdb14fde689f: 2023-07-19 00:11:55,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:55,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dbe5257ac083904452aafdb14fde689f, regionState=CLOSED 2023-07-19 00:11:55,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689725515340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725515340"}]},"ts":"1689725515340"} 2023-07-19 00:11:55,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 00:11:55,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure dbe5257ac083904452aafdb14fde689f, server=jenkins-hbase4.apache.org,42753,1689725420945 in 178 msec 2023-07-19 00:11:55,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 00:11:55,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dbe5257ac083904452aafdb14fde689f, UNASSIGN in 184 msec 2023-07-19 00:11:55,350 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725515350"}]},"ts":"1689725515350"} 2023-07-19 00:11:55,352 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 00:11:55,354 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 00:11:55,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 204 msec 2023-07-19 00:11:55,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 00:11:55,460 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 00:11:55,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,466 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,468 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,468 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,471 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,471 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,471 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,471 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:11:55,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:11:55,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:11:55,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 00:11:55,474 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:55,474 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:55,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,475 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,477 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/recovered.edits] 2023-07-19 00:11:55,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 00:11:55,477 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/recovered.edits] 2023-07-19 00:11:55,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:55,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:55,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:55,479 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/recovered.edits] 2023-07-19 00:11:55,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:55,488 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/ba341acf54ae4fa1a67d6bbf6c26c06d.7195f2820bb426ea966ee4fb03175957 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/ba341acf54ae4fa1a67d6bbf6c26c06d.7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:55,489 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/cf/ba341acf54ae4fa1a67d6bbf6c26c06d 2023-07-19 00:11:55,490 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/cf/e8d1ac237f834ba9888c98378ca9db67 2023-07-19 00:11:55,492 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/e8d1ac237f834ba9888c98378ca9db67.3eac68fa1cbc0846eb7b15ccd0555fd9 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/cf/e8d1ac237f834ba9888c98378ca9db67.3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:55,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/recovered.edits/8.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957/recovered.edits/8.seqid 2023-07-19 00:11:55,503 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7195f2820bb426ea966ee4fb03175957 2023-07-19 00:11:55,503 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/recovered.edits/8.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9/recovered.edits/8.seqid 2023-07-19 00:11:55,504 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3eac68fa1cbc0846eb7b15ccd0555fd9 2023-07-19 00:11:55,507 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/recovered.edits/12.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f/recovered.edits/12.seqid 2023-07-19 00:11:55,508 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dbe5257ac083904452aafdb14fde689f 2023-07-19 00:11:55,508 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 00:11:55,521 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,524 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 00:11:55,528 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 00:11:55,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,530 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 00:11:55,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725515530"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:55,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 00:11:55,534 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dbe5257ac083904452aafdb14fde689f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689725498158.dbe5257ac083904452aafdb14fde689f.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 00:11:55,534 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 00:11:55,535 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725515534"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:55,537 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 00:11:55,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:55,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 78 msec 2023-07-19 00:11:55,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 00:11:55,579 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 00:11:55,580 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,592 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725515592"}]},"ts":"1689725515592"} 2023-07-19 00:11:55,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:11:55,596 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 00:11:55,598 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 00:11:55,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, UNASSIGN}] 2023-07-19 00:11:55,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, UNASSIGN 2023-07-19 00:11:55,601 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, UNASSIGN 2023-07-19 00:11:55,602 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a2637c2775dc44e7e0ac8b994a21c36d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:55,602 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c2025967ebedfcfa047845be939e2d2e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:55,602 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725515602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725515602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725515602"}]},"ts":"1689725515602"} 2023-07-19 00:11:55,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725515602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725515602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725515602"}]},"ts":"1689725515602"} 2023-07-19 00:11:55,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure c2025967ebedfcfa047845be939e2d2e, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:11:55,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure a2637c2775dc44e7e0ac8b994a21c36d, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:11:55,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:55,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2025967ebedfcfa047845be939e2d2e, disabling compactions & flushes 2023-07-19 00:11:55,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:55,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:55,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. after waiting 0 ms 2023-07-19 00:11:55,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:55,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:55,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2637c2775dc44e7e0ac8b994a21c36d, disabling compactions & flushes 2023-07-19 00:11:55,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:55,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:55,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. after waiting 0 ms 2023-07-19 00:11:55,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:55,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:55,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:11:55,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:55,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e. 2023-07-19 00:11:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2025967ebedfcfa047845be939e2d2e: 2023-07-19 00:11:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:11:55,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d. 2023-07-19 00:11:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2637c2775dc44e7e0ac8b994a21c36d: 2023-07-19 00:11:55,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:55,782 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c2025967ebedfcfa047845be939e2d2e, regionState=CLOSED 2023-07-19 00:11:55,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725515782"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725515782"}]},"ts":"1689725515782"} 2023-07-19 00:11:55,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:55,783 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a2637c2775dc44e7e0ac8b994a21c36d, regionState=CLOSED 2023-07-19 00:11:55,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689725515783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725515783"}]},"ts":"1689725515783"} 2023-07-19 00:11:55,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-19 00:11:55,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure c2025967ebedfcfa047845be939e2d2e, server=jenkins-hbase4.apache.org,33821,1689725420836 in 180 msec 2023-07-19 00:11:55,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-19 00:11:55,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2025967ebedfcfa047845be939e2d2e, UNASSIGN in 187 msec 2023-07-19 00:11:55,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure a2637c2775dc44e7e0ac8b994a21c36d, server=jenkins-hbase4.apache.org,42753,1689725420945 in 180 msec 2023-07-19 00:11:55,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-19 00:11:55,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a2637c2775dc44e7e0ac8b994a21c36d, UNASSIGN in 190 msec 2023-07-19 00:11:55,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725515792"}]},"ts":"1689725515792"} 2023-07-19 00:11:55,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 00:11:55,795 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 00:11:55,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 215 msec 2023-07-19 00:11:55,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 00:11:55,896 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 00:11:55,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,903 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,905 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,906 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,913 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:55,913 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,914 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,914 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,914 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:55,914 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 00:11:55,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 00:11:55,916 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,916 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,916 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 00:11:55,916 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:11:55,916 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,916 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:11:55,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 00:11:55,917 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/recovered.edits] 2023-07-19 00:11:55,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 00:11:55,919 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 00:11:55,919 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:55,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/cf/53c035478fc04ad4ba492902c00988b0 2023-07-19 00:11:55,927 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/recovered.edits] 2023-07-19 00:11:55,934 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d/recovered.edits/9.seqid 2023-07-19 00:11:55,935 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a2637c2775dc44e7e0ac8b994a21c36d 2023-07-19 00:11:55,935 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/cf/20a62663c830474c9ec84c4e13bfe33b 2023-07-19 00:11:55,940 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e/recovered.edits/9.seqid 2023-07-19 00:11:55,940 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2025967ebedfcfa047845be939e2d2e 2023-07-19 00:11:55,940 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 00:11:55,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,949 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 00:11:55,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 00:11:55,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 00:11:55,965 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725515964"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:55,965 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725515964"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:55,967 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:11:55,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a2637c2775dc44e7e0ac8b994a21c36d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689725495969.a2637c2775dc44e7e0ac8b994a21c36d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c2025967ebedfcfa047845be939e2d2e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689725495969.c2025967ebedfcfa047845be939e2d2e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:11:55,967 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 00:11:55,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725515967"}]},"ts":"9223372036854775807"} 2023-07-19 00:11:55,969 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 00:11:55,973 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:55,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 75 msec 2023-07-19 00:11:56,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 00:11:56,019 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 00:11:56,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 00:11:56,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:56,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 00:11:56,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 00:11:56,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 00:11:56,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 00:11:56,091 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 749) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:35430 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:40985 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019727638_1 at /127.0.0.1:37638 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:35162 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:37668 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019727638_1 at /127.0.0.1:35408 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=514 (was 521), ProcessCount=188 (was 186) - ProcessCount LEAK? -, AvailableMemoryMB=1407 (was 2012) 2023-07-19 00:11:56,092 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-19 00:11:56,122 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=514, ProcessCount=188, AvailableMemoryMB=1397 2023-07-19 00:11:56,123 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-19 00:11:56,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:11:56,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:11:56,130 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:11:56,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 00:11:56,131 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:11:56,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:11:56,134 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,134 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,135 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 empty. 2023-07-19 00:11:56,136 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 empty. 2023-07-19 00:11:56,136 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,136 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,136 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 00:11:56,180 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 00:11:56,181 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4cf759154dc5096cf7d87d569d06e088, NAME => 'testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:56,182 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 96a8679b177f18fd79c2b6005c7d40a1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4cf759154dc5096cf7d87d569d06e088, disabling compactions & flushes 2023-07-19 00:11:56,192 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. after waiting 0 ms 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,192 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,192 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4cf759154dc5096cf7d87d569d06e088: 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 96a8679b177f18fd79c2b6005c7d40a1, disabling compactions & flushes 2023-07-19 00:11:56,193 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. after waiting 0 ms 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,193 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,193 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 96a8679b177f18fd79c2b6005c7d40a1: 2023-07-19 00:11:56,196 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:11:56,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725516197"}]},"ts":"1689725516197"} 2023-07-19 00:11:56,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725516197"}]},"ts":"1689725516197"} 2023-07-19 00:11:56,199 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:11:56,200 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:11:56,200 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725516200"}]},"ts":"1689725516200"} 2023-07-19 00:11:56,201 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 00:11:56,206 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:11:56,207 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:11:56,207 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:11:56,207 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:11:56,207 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:11:56,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, ASSIGN}] 2023-07-19 00:11:56,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, ASSIGN 2023-07-19 00:11:56,210 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, ASSIGN 2023-07-19 00:11:56,211 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36575,1689725420902; forceNewPlan=false, retain=false 2023-07-19 00:11:56,211 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42753,1689725420945; forceNewPlan=false, retain=false 2023-07-19 00:11:56,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:11:56,361 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:11:56,365 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=96a8679b177f18fd79c2b6005c7d40a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725516365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725516365"}]},"ts":"1689725516365"} 2023-07-19 00:11:56,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4cf759154dc5096cf7d87d569d06e088, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725516365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725516365"}]},"ts":"1689725516365"} 2023-07-19 00:11:56,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4cf759154dc5096cf7d87d569d06e088, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:11:56,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 96a8679b177f18fd79c2b6005c7d40a1, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:11:56,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:11:56,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4cf759154dc5096cf7d87d569d06e088, NAME => 'testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. service=AccessControlService 2023-07-19 00:11:56,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96a8679b177f18fd79c2b6005c7d40a1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. service=AccessControlService 2023-07-19 00:11:56,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:11:56,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:11:56,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,549 INFO [StoreOpener-4cf759154dc5096cf7d87d569d06e088-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,550 INFO [StoreOpener-96a8679b177f18fd79c2b6005c7d40a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,552 DEBUG [StoreOpener-4cf759154dc5096cf7d87d569d06e088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf 2023-07-19 00:11:56,552 DEBUG [StoreOpener-4cf759154dc5096cf7d87d569d06e088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf 2023-07-19 00:11:56,553 INFO [StoreOpener-4cf759154dc5096cf7d87d569d06e088-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cf759154dc5096cf7d87d569d06e088 columnFamilyName cf 2023-07-19 00:11:56,554 DEBUG [StoreOpener-96a8679b177f18fd79c2b6005c7d40a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf 2023-07-19 00:11:56,554 DEBUG [StoreOpener-96a8679b177f18fd79c2b6005c7d40a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf 2023-07-19 00:11:56,554 INFO [StoreOpener-4cf759154dc5096cf7d87d569d06e088-1] regionserver.HStore(310): Store=4cf759154dc5096cf7d87d569d06e088/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:56,554 INFO [StoreOpener-96a8679b177f18fd79c2b6005c7d40a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96a8679b177f18fd79c2b6005c7d40a1 columnFamilyName cf 2023-07-19 00:11:56,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,555 INFO [StoreOpener-96a8679b177f18fd79c2b6005c7d40a1-1] regionserver.HStore(310): Store=96a8679b177f18fd79c2b6005c7d40a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:11:56,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:11:56,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:11:56,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:56,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4cf759154dc5096cf7d87d569d06e088; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74813391, jitterRate=0.1148063987493515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:56,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4cf759154dc5096cf7d87d569d06e088: 2023-07-19 00:11:56,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:11:56,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96a8679b177f18fd79c2b6005c7d40a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59265676, jitterRate=-0.11687260866165161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:11:56,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96a8679b177f18fd79c2b6005c7d40a1: 2023-07-19 00:11:56,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088., pid=93, masterSystemTime=1689725516524 2023-07-19 00:11:56,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1., pid=94, masterSystemTime=1689725516526 2023-07-19 00:11:56,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4cf759154dc5096cf7d87d569d06e088, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,583 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725516582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725516582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725516582"}]},"ts":"1689725516582"} 2023-07-19 00:11:56,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=96a8679b177f18fd79c2b6005c7d40a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,584 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725516583"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725516583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725516583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725516583"}]},"ts":"1689725516583"} 2023-07-19 00:11:56,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 00:11:56,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4cf759154dc5096cf7d87d569d06e088, server=jenkins-hbase4.apache.org,36575,1689725420902 in 223 msec 2023-07-19 00:11:56,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 00:11:56,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 96a8679b177f18fd79c2b6005c7d40a1, server=jenkins-hbase4.apache.org,42753,1689725420945 in 223 msec 2023-07-19 00:11:56,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, ASSIGN in 388 msec 2023-07-19 00:11:56,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 00:11:56,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, ASSIGN in 388 msec 2023-07-19 00:11:56,601 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:11:56,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725516601"}]},"ts":"1689725516601"} 2023-07-19 00:11:56,603 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 00:11:56,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:11:56,607 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 00:11:56,611 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:11:56,613 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:56,613 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:56,613 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:56,613 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:11:56,617 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:56,617 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:11:56,617 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:56,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:56,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 00:11:56,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 492 msec 2023-07-19 00:11:56,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 00:11:56,736 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 00:11:56,736 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 00:11:56,736 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:56,740 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 00:11:56,741 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:56,741 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 00:11:56,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:56,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725516744 (current time:1689725516744). 2023-07-19 00:11:56,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:56,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x53274cf6 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:56,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a1a9ef6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:56,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:56,762 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:56,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53274cf6 to 127.0.0.1:55216 2023-07-19 00:11:56,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:56,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x4dacd16c to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:56,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@248564d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:56,776 DEBUG [hconnection-0x6a26a39b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:56,777 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:56,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dacd16c to 127.0.0.1:55216 2023-07-19 00:11:56,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:11:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:56,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:56,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:56,788 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:56,795 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726116795 2023-07-19 00:11:56,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:56,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 00:11:56,797 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:56,797 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:56,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:56,799 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:56,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-19 00:11:56,807 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:56,808 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726116808 2023-07-19 00:11:56,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,842 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 00:11:56,842 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:56,844 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 00:11:56,844 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:11:56,845 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,845 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:56,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:56,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:56,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:56,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:56,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:56,851 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,851 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,851 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,852 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,852 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:11:56,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:56,853 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:56,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,855 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:56,855 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:56,855 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:56,855 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:56,855 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:56,858 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:56,858 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:56,858 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:56,859 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,859 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:56,859 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,859 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:56,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41d93268[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:56,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:56,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:11:56,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41d93268[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:56,866 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:11:56,866 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,869 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:56,870 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:56,870 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,870 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:56,870 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,870 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:56,870 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:56,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,870 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:56,873 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:56,873 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:56,873 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:56,885 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:56,885 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:56,885 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,885 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:56,885 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:56,885 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:56,885 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. started... 2023-07-19 00:11:56,885 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. started... 2023-07-19 00:11:56,892 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96a8679b177f18fd79c2b6005c7d40a1: 2023-07-19 00:11:56,901 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,902 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:56,902 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:56,897 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:56,908 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:56,898 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4cf759154dc5096cf7d87d569d06e088: 2023-07-19 00:11:56,913 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,913 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:56,913 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:11:56,956 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. completed. 2023-07-19 00:11:56,956 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:56,959 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:56,959 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:56,959 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:56,961 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:56,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:11:57,108 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:57,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:57,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:57,110 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:11:57,354 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. completed. 2023-07-19 00:11:57,354 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:57,354 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:57,357 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,357 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:57,357 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:57,357 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:11:57,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:11:57,372 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 00:11:57,372 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:57,373 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:57,373 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,373 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,377 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,377 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,378 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,380 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,380 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,381 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,382 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:57,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,385 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:57,386 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:57,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:57,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:57,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:57,386 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:57,388 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,388 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:57,388 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:57,388 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,388 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:57,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-19 00:11:57,411 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:57,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:57,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:57,413 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:11:57,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 00:11:57,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:57,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689725516795Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689725517386 (+591 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689725517388 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689725517427 (+39 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689725517461 (+34 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689725517599 (+138 ms) 2023-07-19 00:11:57,605 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:57,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 808 msec 2023-07-19 00:11:57,913 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:57,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:57,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:57,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36575] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:57,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42753] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:11:57,933 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 00:11:57,933 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:57,933 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:11:57,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:57,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725517958 (current time:1689725517958). 2023-07-19 00:11:57,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:11:57,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x4442d10d to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:58,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b278865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:58,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:58,006 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:58,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4442d10d to 127.0.0.1:55216 2023-07-19 00:11:58,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:58,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x54324e39 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:11:58,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62a270b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:11:58,026 DEBUG [hconnection-0x21e9e30b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:11:58,029 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:11:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54324e39 to 127.0.0.1:55216 2023-07-19 00:11:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:11:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 00:11:58,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:11:58,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:58,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:58,039 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:58,040 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689726118040 2023-07-19 00:11:58,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 00:11:58,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 00:11:58,042 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:11:58,042 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:11:58,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:58,046 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 00:11:58,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-19 00:11:58,049 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:58,050 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689726118050 2023-07-19 00:11:58,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,077 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 00:11:58,078 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:58,080 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 00:11:58,080 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 00:11:58,140 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,140 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,142 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,142 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,142 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,142 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,143 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:58,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,143 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,143 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:58,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,144 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,145 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:58,145 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 00:11:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:11:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 00:11:58,146 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:11:58,146 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:58,147 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:58,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,149 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:58,149 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:58,150 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 00:11:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 00:11:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 00:11:58,159 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:58,159 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,161 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,161 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:58,165 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,165 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,167 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,167 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:11:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:58,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:11:58,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505e8aa0[Count = 1] remaining members to acquire global barrier 2023-07-19 00:11:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:58,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 00:11:58,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505e8aa0[Count = 0] remaining members to acquire global barrier 2023-07-19 00:11:58,174 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 00:11:58,174 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,180 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,180 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,180 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:58,181 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:11:58,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,181 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:11:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 00:11:58,182 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:58,182 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:58,182 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:58,182 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. started... 2023-07-19 00:11:58,182 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4cf759154dc5096cf7d87d569d06e088 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 00:11:58,183 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:58,183 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. started... 2023-07-19 00:11:58,183 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 96a8679b177f18fd79c2b6005c7d40a1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 00:11:58,183 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:11:58,183 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:11:58,183 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:58,183 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:58,183 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:58,200 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/.tmp/cf/7e9c2163a4374e88b8f8a9c068fa3e57 2023-07-19 00:11:58,200 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/.tmp/cf/469addce1cc34592a89c6389ffa89cda 2023-07-19 00:11:58,207 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/.tmp/cf/469addce1cc34592a89c6389ffa89cda as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda 2023-07-19 00:11:58,208 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/.tmp/cf/7e9c2163a4374e88b8f8a9c068fa3e57 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57 2023-07-19 00:11:58,213 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda, entries=47, sequenceid=6, filesize=8 K 2023-07-19 00:11:58,213 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 00:11:58,214 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4cf759154dc5096cf7d87d569d06e088 in 32ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:58,214 INFO [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 96a8679b177f18fd79c2b6005c7d40a1 in 31ms, sequenceid=6, compaction requested=false 2023-07-19 00:11:58,214 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 00:11:58,214 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4cf759154dc5096cf7d87d569d06e088: 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96a8679b177f18fd79c2b6005c7d40a1: 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57] hfiles 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda] hfiles 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,218 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,231 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. completed. 2023-07-19 00:11:58,231 DEBUG [rs(jenkins-hbase4.apache.org,42753,1689725420945)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:11:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:58,231 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:11:58,234 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. completed. 2023-07-19 00:11:58,234 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:11:58,234 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,234 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:58,237 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:58,237 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 00:11:58,237 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:58,237 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 00:11:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:58,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42753,1689725420945': 2023-07-19 00:11:58,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 00:11:58,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:58,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:11:58,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 00:11:58,247 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 00:11:58,247 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:11:58,247 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:11:58,247 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,247 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:11:58,249 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,249 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,249 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,249 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,250 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:11:58,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,250 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,251 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,251 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,253 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:11:58,254 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,254 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:11:58,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,263 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:11:58,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,262 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:11:58,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,262 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:11:58,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:11:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:11:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:11:58,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 00:11:58,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,335 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689725518040Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689725518262 (+222 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689725518262Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689725518268 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689725518281 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689725518334 (+53 ms) 2023-07-19 00:11:58,338 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 00:11:58,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 296 msec 2023-07-19 00:11:58,347 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:11:58,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 00:11:58,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:11:58,348 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348 2023-07-19 00:11:58,349 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39213, tgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348, rawTgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:58,376 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:11:58,376 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-187750668_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,376 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 00:11:58,401 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:11:58,532 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,532 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,533 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,533 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,534 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,534 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,535 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,620 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-5358877069466696946.jar 2023-07-19 00:11:58,620 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,621 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,621 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,621 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:11:58,622 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:11:58,623 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:11:58,623 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:11:58,623 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:11:58,624 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:11:58,625 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:11:58,625 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:11:58,626 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:11:58,626 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:11:58,626 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:11:58,627 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:58,627 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:58,628 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:58,628 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:58,629 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:11:58,629 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:58,630 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:11:59,516 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0005_000001 (auth:SIMPLE) 2023-07-19 00:11:59,761 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:11:59,763 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 00:11:59,847 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:11:59,847 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:00,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:00,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:06,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:08,978 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:12:08,978 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:12:08,984 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:08,984 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:12:08,985 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:12:08,985 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:08,985 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 00:12:08,985 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 00:12:08,986 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:08,986 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 00:12:08,986 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725518348/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 00:12:08,991 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 00:12:08,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 00:12:08,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:08,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:08,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725528996"}]},"ts":"1689725528996"} 2023-07-19 00:12:08,998 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 00:12:08,999 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 00:12:09,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, UNASSIGN}] 2023-07-19 00:12:09,002 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, UNASSIGN 2023-07-19 00:12:09,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, UNASSIGN 2023-07-19 00:12:09,003 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4cf759154dc5096cf7d87d569d06e088, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:09,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=96a8679b177f18fd79c2b6005c7d40a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:09,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725529003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725529003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725529003"}]},"ts":"1689725529003"} 2023-07-19 00:12:09,003 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725529003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725529003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725529003"}]},"ts":"1689725529003"} 2023-07-19 00:12:09,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 4cf759154dc5096cf7d87d569d06e088, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:12:09,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 96a8679b177f18fd79c2b6005c7d40a1, server=jenkins-hbase4.apache.org,42753,1689725420945}] 2023-07-19 00:12:09,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:09,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:12:09,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:12:09,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96a8679b177f18fd79c2b6005c7d40a1, disabling compactions & flushes 2023-07-19 00:12:09,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4cf759154dc5096cf7d87d569d06e088, disabling compactions & flushes 2023-07-19 00:12:09,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:12:09,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. after waiting 0 ms 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. after waiting 0 ms 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:12:09,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:12:09,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:09,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:09,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1. 2023-07-19 00:12:09,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96a8679b177f18fd79c2b6005c7d40a1: 2023-07-19 00:12:09,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:09,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:09,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088. 2023-07-19 00:12:09,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4cf759154dc5096cf7d87d569d06e088: 2023-07-19 00:12:09,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=96a8679b177f18fd79c2b6005c7d40a1, regionState=CLOSED 2023-07-19 00:12:09,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725529186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725529186"}]},"ts":"1689725529186"} 2023-07-19 00:12:09,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:12:09,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:12:09,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4cf759154dc5096cf7d87d569d06e088, regionState=CLOSED 2023-07-19 00:12:09,187 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689725529186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725529186"}]},"ts":"1689725529186"} 2023-07-19 00:12:09,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 00:12:09,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 96a8679b177f18fd79c2b6005c7d40a1, server=jenkins-hbase4.apache.org,42753,1689725420945 in 181 msec 2023-07-19 00:12:09,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 00:12:09,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 4cf759154dc5096cf7d87d569d06e088, server=jenkins-hbase4.apache.org,36575,1689725420902 in 183 msec 2023-07-19 00:12:09,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96a8679b177f18fd79c2b6005c7d40a1, UNASSIGN in 189 msec 2023-07-19 00:12:09,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 00:12:09,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cf759154dc5096cf7d87d569d06e088, UNASSIGN in 190 msec 2023-07-19 00:12:09,192 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725529192"}]},"ts":"1689725529192"} 2023-07-19 00:12:09,199 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 00:12:09,201 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 00:12:09,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 209 msec 2023-07-19 00:12:09,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 00:12:09,299 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 00:12:09,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,304 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,305 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,306 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,311 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,311 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,311 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,311 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,312 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:12:09,312 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:12:09,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:09,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:09,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:09,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,314 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:09,315 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/recovered.edits] 2023-07-19 00:12:09,315 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/recovered.edits] 2023-07-19 00:12:09,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 00:12:09,323 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/cf/469addce1cc34592a89c6389ffa89cda 2023-07-19 00:12:09,324 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/cf/7e9c2163a4374e88b8f8a9c068fa3e57 2023-07-19 00:12:09,335 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1/recovered.edits/9.seqid 2023-07-19 00:12:09,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/96a8679b177f18fd79c2b6005c7d40a1 2023-07-19 00:12:09,341 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088/recovered.edits/9.seqid 2023-07-19 00:12:09,341 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cf759154dc5096cf7d87d569d06e088 2023-07-19 00:12:09,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 00:12:09,344 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,349 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 00:12:09,352 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 00:12:09,354 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,354 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 00:12:09,354 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725529354"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:09,354 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725529354"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:09,357 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:12:09,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4cf759154dc5096cf7d87d569d06e088, NAME => 'testtb-testEmptyExportFileSystemState,,1689725516124.4cf759154dc5096cf7d87d569d06e088.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 96a8679b177f18fd79c2b6005c7d40a1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689725516124.96a8679b177f18fd79c2b6005c7d40a1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:12:09,357 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 00:12:09,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725529357"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:09,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 00:12:09,362 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 00:12:09,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 63 msec 2023-07-19 00:12:09,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 00:12:09,417 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 00:12:09,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 00:12:09,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:09,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 00:12:09,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 00:12:09,472 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_926248899_1 at /127.0.0.1:44394 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:45699 from appattempt_1689725428835_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:35756 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:52176 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:33419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:41251 from appattempt_1689725428835_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4598 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:37905 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:44432 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=497 (was 514), ProcessCount=185 (was 188), AvailableMemoryMB=2013 (was 1397) - AvailableMemoryMB LEAK? - 2023-07-19 00:12:09,473 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 00:12:09,503 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=497, ProcessCount=185, AvailableMemoryMB=2007 2023-07-19 00:12:09,504 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 00:12:09,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 00:12:09,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:09,509 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 00:12:09,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 00:12:09,513 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 00:12:09,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:09,521 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:09,521 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:09,521 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 empty. 2023-07-19 00:12:09,521 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 empty. 2023-07-19 00:12:09,522 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:09,522 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:09,522 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 00:12:09,558 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 00:12:09,559 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4e1d1f97386b313d110b36ee1a6a05d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:12:09,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e7d71c33f2ff05ac96f5c67f0aa54214, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4e1d1f97386b313d110b36ee1a6a05d3, disabling compactions & flushes 2023-07-19 00:12:09,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. after waiting 0 ms 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:09,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:09,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4e1d1f97386b313d110b36ee1a6a05d3: 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e7d71c33f2ff05ac96f5c67f0aa54214, disabling compactions & flushes 2023-07-19 00:12:09,601 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. after waiting 0 ms 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:09,601 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:09,601 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e7d71c33f2ff05ac96f5c67f0aa54214: 2023-07-19 00:12:09,604 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 00:12:09,605 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725529605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725529605"}]},"ts":"1689725529605"} 2023-07-19 00:12:09,605 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725529605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725529605"}]},"ts":"1689725529605"} 2023-07-19 00:12:09,607 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 00:12:09,608 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 00:12:09,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725529608"}]},"ts":"1689725529608"} 2023-07-19 00:12:09,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 00:12:09,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:09,739 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 00:12:09,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 00:12:09,741 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 00:12:09,741 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 00:12:09,741 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 00:12:09,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, ASSIGN}] 2023-07-19 00:12:09,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, ASSIGN 2023-07-19 00:12:09,744 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, ASSIGN 2023-07-19 00:12:09,746 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33821,1689725420836; forceNewPlan=false, retain=false 2023-07-19 00:12:09,746 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36575,1689725420902; forceNewPlan=false, retain=false 2023-07-19 00:12:09,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:09,896 INFO [jenkins-hbase4:35857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 00:12:09,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e7d71c33f2ff05ac96f5c67f0aa54214, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:09,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4e1d1f97386b313d110b36ee1a6a05d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:09,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725529900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725529900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725529900"}]},"ts":"1689725529900"} 2023-07-19 00:12:09,900 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725529900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725529900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725529900"}]},"ts":"1689725529900"} 2023-07-19 00:12:09,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure e7d71c33f2ff05ac96f5c67f0aa54214, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:12:09,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 4e1d1f97386b313d110b36ee1a6a05d3, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:12:10,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7d71c33f2ff05ac96f5c67f0aa54214, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. service=AccessControlService 2023-07-19 00:12:10,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,073 INFO [StoreOpener-e7d71c33f2ff05ac96f5c67f0aa54214-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,076 DEBUG [StoreOpener-e7d71c33f2ff05ac96f5c67f0aa54214-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf 2023-07-19 00:12:10,076 DEBUG [StoreOpener-e7d71c33f2ff05ac96f5c67f0aa54214-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf 2023-07-19 00:12:10,076 INFO [StoreOpener-e7d71c33f2ff05ac96f5c67f0aa54214-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7d71c33f2ff05ac96f5c67f0aa54214 columnFamilyName cf 2023-07-19 00:12:10,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:10,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e1d1f97386b313d110b36ee1a6a05d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 00:12:10,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. service=AccessControlService 2023-07-19 00:12:10,077 INFO [StoreOpener-e7d71c33f2ff05ac96f5c67f0aa54214-1] regionserver.HStore(310): Store=e7d71c33f2ff05ac96f5c67f0aa54214/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:10,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 00:12:10,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 00:12:10,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:10,088 INFO [StoreOpener-4e1d1f97386b313d110b36ee1a6a05d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:10,090 DEBUG [StoreOpener-4e1d1f97386b313d110b36ee1a6a05d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf 2023-07-19 00:12:10,090 DEBUG [StoreOpener-4e1d1f97386b313d110b36ee1a6a05d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf 2023-07-19 00:12:10,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7d71c33f2ff05ac96f5c67f0aa54214; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66244406, jitterRate=-0.012881428003311157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:10,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7d71c33f2ff05ac96f5c67f0aa54214: 2023-07-19 00:12:10,090 INFO [StoreOpener-4e1d1f97386b313d110b36ee1a6a05d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e1d1f97386b313d110b36ee1a6a05d3 columnFamilyName cf 2023-07-19 00:12:10,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214., pid=108, masterSystemTime=1689725530056 2023-07-19 00:12:10,093 INFO [StoreOpener-4e1d1f97386b313d110b36ee1a6a05d3-1] regionserver.HStore(310): Store=4e1d1f97386b313d110b36ee1a6a05d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 00:12:10,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:10,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:10,095 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e7d71c33f2ff05ac96f5c67f0aa54214, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:10,095 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725530095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725530095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725530095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725530095"}]},"ts":"1689725530095"} 2023-07-19 00:12:10,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:10,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-19 00:12:10,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure e7d71c33f2ff05ac96f5c67f0aa54214, server=jenkins-hbase4.apache.org,36575,1689725420902 in 193 msec 2023-07-19 00:12:10,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, ASSIGN in 358 msec 2023-07-19 00:12:10,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 00:12:10,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e1d1f97386b313d110b36ee1a6a05d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67199632, jitterRate=0.001352548599243164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 00:12:10,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e1d1f97386b313d110b36ee1a6a05d3: 2023-07-19 00:12:10,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3., pid=109, masterSystemTime=1689725530063 2023-07-19 00:12:10,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:10,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:10,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4e1d1f97386b313d110b36ee1a6a05d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:10,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725530105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689725530105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689725530105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689725530105"}]},"ts":"1689725530105"} 2023-07-19 00:12:10,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-19 00:12:10,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 4e1d1f97386b313d110b36ee1a6a05d3, server=jenkins-hbase4.apache.org,33821,1689725420836 in 203 msec 2023-07-19 00:12:10,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-19 00:12:10,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, ASSIGN in 369 msec 2023-07-19 00:12:10,114 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 00:12:10,114 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725530114"}]},"ts":"1689725530114"} 2023-07-19 00:12:10,117 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 00:12:10,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:10,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 00:12:10,194 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 00:12:10,197 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:10,277 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:10,277 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:10,277 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:10,277 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:10,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:10,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:10,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:10,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 00:12:10,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 833 msec 2023-07-19 00:12:10,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 00:12:10,620 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 00:12:10,620 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 00:12:10,621 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:10,623 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 00:12:10,624 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:10,624 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 00:12:10,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:10,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725530631 (current time:1689725530631). 2023-07-19 00:12:10,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:10,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x4d803cdd to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18eb880c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:10,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:10,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d803cdd to 127.0.0.1:55216 2023-07-19 00:12:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x3e5b8028 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:10,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f125ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:10,889 DEBUG [hconnection-0x369e6850-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:10,893 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:10,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e5b8028 to 127.0.0.1:55216 2023-07-19 00:12:10,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:10,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:10,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:10,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:10,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:10,909 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:10,909 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689726130909 2023-07-19 00:12:10,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:10,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:10,911 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:10,911 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:10,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:10,913 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:10,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 00:12:10,916 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:10,917 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689726130917 2023-07-19 00:12:11,011 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:11,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:11,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:11,013 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:11,213 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:11,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:11,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:11,220 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:11,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,339 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:11,339 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:11,339 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 00:12:11,339 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 00:12:11,340 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,340 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,342 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,342 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,342 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,343 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,343 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:11,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:11,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,344 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:11,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:11,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:11,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:11,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,353 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:11,363 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:11,363 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:11,363 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:11,369 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,369 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,369 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:11,370 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,370 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:11,370 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,370 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:11,370 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,371 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:11,371 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,371 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:11,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b3b2bb3[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:11,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:11,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:11,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b3b2bb3[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:11,379 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 00:12:11,380 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,381 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:11,381 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:11,381 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,381 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:11,381 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:12:11,381 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:11,382 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,382 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:11,382 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:11,382 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:11,383 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:11,383 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. started... 2023-07-19 00:12:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:11,386 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:11,386 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7d71c33f2ff05ac96f5c67f0aa54214: 2023-07-19 00:12:11,386 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:11,386 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. started... 2023-07-19 00:12:11,386 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e1d1f97386b313d110b36ee1a6a05d3: 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:11,388 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 00:12:11,404 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:11,428 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. completed. 2023-07-19 00:12:11,428 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:12:11,431 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:11,436 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. completed. 2023-07-19 00:12:11,436 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:11,436 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:11,436 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:11,436 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,436 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:11,436 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:12:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:11,442 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:11,442 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,442 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:11,442 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:12:11,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 00:12:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:12:11,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 00:12:11,454 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 00:12:11,454 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:11,455 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:11,455 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,455 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,457 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:11,457 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:11,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:11,468 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,474 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,477 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:11,478 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,479 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,486 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:11,487 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:11,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,490 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,486 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:11,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:11,520 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:11,521 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 00:12:11,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 00:12:11,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,636 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:11,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689725530909Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725531489 (+580 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725531489Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725531495 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689725531556 (+61 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689725531635 (+79 ms) 2023-07-19 00:12:11,639 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:11,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 728 msec 2023-07-19 00:12:12,022 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:12,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:12,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:12,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:12,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33821] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 00:12:12,071 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,071 DEBUG [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:12,073 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 00:12:12,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:12,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689725532107 (current time:1689725532107). 2023-07-19 00:12:12,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 00:12:12,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x32914957 to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:12,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77087bbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:12,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:12,161 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:12,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32914957 to 127.0.0.1:55216 2023-07-19 00:12:12,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:12,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(139): Connect 0x51ea617f to 127.0.0.1:55216 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 00:12:12,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698951e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 00:12:12,178 DEBUG [hconnection-0x5d681afb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 00:12:12,182 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 00:12:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51ea617f to 127.0.0.1:55216 2023-07-19 00:12:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 00:12:12,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 00:12:12,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:12,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:12,197 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:12,199 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689726132199 2023-07-19 00:12:12,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 00:12:12,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,204 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 00:12:12,204 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 00:12:12,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:12,207 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 00:12:12,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 13 msec 2023-07-19 00:12:12,211 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:12,212 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689726132212 2023-07-19 00:12:12,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,275 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 00:12:12,275 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:12,285 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 00:12:12,285 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 00:12:12,299 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,299 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,301 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,301 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,301 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,301 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,302 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,302 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,303 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:12,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:12,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,304 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:12,304 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:12,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:12,325 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:12,314 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:12,325 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:12,325 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:12,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:12,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:12,327 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 00:12:12,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,331 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:12,331 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:12,340 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:12,340 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:12,340 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:12,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 00:12:12,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 00:12:12,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,342 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 00:12:12,342 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 00:12:12,345 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 00:12:12,345 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 00:12:12,345 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42753,1689725420945' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 00:12:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,349 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,349 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:12,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,350 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,350 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:12,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 00:12:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36575,1689725420902' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e3b131a[Count = 1] remaining members to acquire global barrier 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:12,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33821,1689725420836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 00:12:12,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e3b131a[Count = 0] remaining members to acquire global barrier 2023-07-19 00:12:12,357 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 00:12:12,357 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,364 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,364 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:12,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,364 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42753,1689725420945' in zk 2023-07-19 00:12:12,365 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:12,365 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,366 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:12,366 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. started... 2023-07-19 00:12:12,366 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4e1d1f97386b313d110b36ee1a6a05d3 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 00:12:12,366 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,366 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 00:12:12,367 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:12,367 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:12,367 DEBUG [member: 'jenkins-hbase4.apache.org,42753,1689725420945' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 00:12:12,368 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 00:12:12,374 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:12,375 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. started... 2023-07-19 00:12:12,375 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7d71c33f2ff05ac96f5c67f0aa54214 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 00:12:12,429 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/.tmp/cf/2109959da9e64d91ab1ebbeeddbfc939 2023-07-19 00:12:12,444 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/.tmp/cf/86200168dace472cb8bf15ccda491f0d 2023-07-19 00:12:12,445 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/.tmp/cf/2109959da9e64d91ab1ebbeeddbfc939 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939 2023-07-19 00:12:12,454 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 00:12:12,455 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/.tmp/cf/86200168dace472cb8bf15ccda491f0d as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d 2023-07-19 00:12:12,456 INFO [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4e1d1f97386b313d110b36ee1a6a05d3 in 90ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:12,458 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e1d1f97386b313d110b36ee1a6a05d3: 2023-07-19 00:12:12,458 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,458 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:12,458 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939] hfiles 2023-07-19 00:12:12,458 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,469 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 00:12:12,470 INFO [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e7d71c33f2ff05ac96f5c67f0aa54214 in 95ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:12,470 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7d71c33f2ff05ac96f5c67f0aa54214: 2023-07-19 00:12:12,470 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,471 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 00:12:12,471 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d] hfiles 2023-07-19 00:12:12,471 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,491 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. completed. 2023-07-19 00:12:12,491 DEBUG [rs(jenkins-hbase4.apache.org,33821,1689725420836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:12,493 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:12,493 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:12,493 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,495 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:12,495 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33821,1689725420836' in zk 2023-07-19 00:12:12,498 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:12,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:12,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,33821,1689725420836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:12,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:12,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:12,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:12,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33821,1689725420836': 2023-07-19 00:12:12,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33821,1689725420836' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 00:12:12,522 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. completed. 2023-07-19 00:12:12,522 DEBUG [rs(jenkins-hbase4.apache.org,36575,1689725420902)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 00:12:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 00:12:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 00:12:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36575,1689725420902' in zk 2023-07-19 00:12:12,524 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,524 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 00:12:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:12,524 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:12,524 DEBUG [member: 'jenkins-hbase4.apache.org,36575,1689725420902' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 00:12:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:12,527 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:12,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:12,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 00:12:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,528 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 00:12:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36575,1689725420902': 2023-07-19 00:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36575,1689725420902' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 00:12:12,531 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 00:12:12,531 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 00:12:12,532 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 00:12:12,532 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,532 INFO [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,536 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 00:12:12,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,538 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 00:12:12,539 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,539 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 00:12:12,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,542 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,542 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,542 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,545 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 00:12:12,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 00:12:12,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:12,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,547 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 00:12:12,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 00:12:12,547 DEBUG [(jenkins-hbase4.apache.org,35857,1689725419330)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 00:12:12,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,672 WARN [DataStreamer for file /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-19 00:12:12,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 00:12:12,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,708 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689725532199Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689725532548 (+349 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689725532548Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689725532567 (+19 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689725532598 (+31 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689725532708 (+110 ms) 2023-07-19 00:12:12,712 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 00:12:12,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 507 msec 2023-07-19 00:12:12,828 DEBUG [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 00:12:12,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 00:12:12,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 00:12:12,830 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830 2023-07-19 00:12:12,830 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39213, tgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830, rawTgtDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830, srcFsUri=hdfs://localhost:39213, srcDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:12:12,862 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b 2023-07-19 00:12:12,862 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1928635227_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:12,862 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39213, inputRoot=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b, snapshotDir=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 00:12:12,935 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:13,126 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,127 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,128 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,128 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,129 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,129 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,129 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,227 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/hadoop-6896266511170758125.jar 2023-07-19 00:12:13,227 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,228 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,228 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,228 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,229 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,229 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 00:12:13,230 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 00:12:13,231 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 00:12:13,231 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 00:12:13,232 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 00:12:13,232 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 00:12:13,233 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 00:12:13,234 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 00:12:13,234 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 00:12:13,235 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 00:12:13,235 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 00:12:13,236 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:13,236 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:13,237 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:13,237 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:13,237 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 00:12:13,238 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:13,238 DEBUG [Listener at jenkins-hbase4.apache.org/36577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 00:12:13,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0006_000001 (auth:SIMPLE) 2023-07-19 00:12:14,382 WARN [Listener at jenkins-hbase4.apache.org/36577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 00:12:14,385 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 00:12:14,387 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 00:12:14,469 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:14,469 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 00:12:14,533 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:14,786 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:20,658 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:22,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:26,783 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689725428835_0007_000001 (auth:SIMPLE) 2023-07-19 00:12:28,633 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 00:12:28,633 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 00:12:28,643 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,644 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 00:12:28,644 INFO [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 00:12:28,644 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 00:12:28,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 00:12:28,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748149066_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 00:12:28,645 DEBUG [Listener at jenkins-hbase4.apache.org/36577] snapshot.TestExportSnapshot(367): hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/export-test/export-1689725532830/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 00:12:28,652 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:28,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725548656"}]},"ts":"1689725548656"} 2023-07-19 00:12:28,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 00:12:28,660 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 00:12:28,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, UNASSIGN}] 2023-07-19 00:12:28,663 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, UNASSIGN 2023-07-19 00:12:28,663 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, UNASSIGN 2023-07-19 00:12:28,664 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4e1d1f97386b313d110b36ee1a6a05d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:28,664 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e7d71c33f2ff05ac96f5c67f0aa54214, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:28,664 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725548664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725548664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725548664"}]},"ts":"1689725548664"} 2023-07-19 00:12:28,664 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725548664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689725548664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689725548664"}]},"ts":"1689725548664"} 2023-07-19 00:12:28,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure e7d71c33f2ff05ac96f5c67f0aa54214, server=jenkins-hbase4.apache.org,36575,1689725420902}] 2023-07-19 00:12:28,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 4e1d1f97386b313d110b36ee1a6a05d3, server=jenkins-hbase4.apache.org,33821,1689725420836}] 2023-07-19 00:12:28,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:28,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7d71c33f2ff05ac96f5c67f0aa54214, disabling compactions & flushes 2023-07-19 00:12:28,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. after waiting 0 ms 2023-07-19 00:12:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:28,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e1d1f97386b313d110b36ee1a6a05d3, disabling compactions & flushes 2023-07-19 00:12:28,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. after waiting 0 ms 2023-07-19 00:12:28,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:28,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:28,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:28,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214. 2023-07-19 00:12:28,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7d71c33f2ff05ac96f5c67f0aa54214: 2023-07-19 00:12:28,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:28,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:28,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:28,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3. 2023-07-19 00:12:28,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e1d1f97386b313d110b36ee1a6a05d3: 2023-07-19 00:12:28,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e7d71c33f2ff05ac96f5c67f0aa54214, regionState=CLOSED 2023-07-19 00:12:28,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725548844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725548844"}]},"ts":"1689725548844"} 2023-07-19 00:12:28,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:28,846 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4e1d1f97386b313d110b36ee1a6a05d3, regionState=CLOSED 2023-07-19 00:12:28,846 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689725548846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689725548846"}]},"ts":"1689725548846"} 2023-07-19 00:12:28,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-19 00:12:28,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure e7d71c33f2ff05ac96f5c67f0aa54214, server=jenkins-hbase4.apache.org,36575,1689725420902 in 181 msec 2023-07-19 00:12:28,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-19 00:12:28,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 4e1d1f97386b313d110b36ee1a6a05d3, server=jenkins-hbase4.apache.org,33821,1689725420836 in 182 msec 2023-07-19 00:12:28,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e7d71c33f2ff05ac96f5c67f0aa54214, UNASSIGN in 187 msec 2023-07-19 00:12:28,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 00:12:28,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e1d1f97386b313d110b36ee1a6a05d3, UNASSIGN in 188 msec 2023-07-19 00:12:28,851 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689725548851"}]},"ts":"1689725548851"} 2023-07-19 00:12:28,852 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 00:12:28,853 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 00:12:28,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 202 msec 2023-07-19 00:12:28,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 00:12:28,959 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 00:12:28,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,963 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,964 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,965 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33821] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,969 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:28,969 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:28,969 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,969 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,969 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,969 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:28,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:28,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:28,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 00:12:28,971 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,971 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:28,971 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,971 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,972 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:28,972 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:28,972 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,972 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 00:12:28,972 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/recovered.edits] 2023-07-19 00:12:28,973 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf, FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/recovered.edits] 2023-07-19 00:12:28,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 00:12:28,977 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/cf/86200168dace472cb8bf15ccda491f0d 2023-07-19 00:12:28,977 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939 to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/cf/2109959da9e64d91ab1ebbeeddbfc939 2023-07-19 00:12:28,980 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214/recovered.edits/9.seqid 2023-07-19 00:12:28,980 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/recovered.edits/9.seqid to hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3/recovered.edits/9.seqid 2023-07-19 00:12:28,981 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e7d71c33f2ff05ac96f5c67f0aa54214 2023-07-19 00:12:28,981 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e1d1f97386b313d110b36ee1a6a05d3 2023-07-19 00:12:28,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 00:12:28,983 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,985 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 00:12:28,987 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 00:12:28,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 00:12:28,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725548988"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:28,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689725548988"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:28,989 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 00:12:28,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e1d1f97386b313d110b36ee1a6a05d3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689725529505.4e1d1f97386b313d110b36ee1a6a05d3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e7d71c33f2ff05ac96f5c67f0aa54214, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689725529505.e7d71c33f2ff05ac96f5c67f0aa54214.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 00:12:28,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 00:12:28,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689725548989"}]},"ts":"9223372036854775807"} 2023-07-19 00:12:28,991 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 00:12:28,993 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:28,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-07-19 00:12:29,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 00:12:29,074 INFO [Listener at jenkins-hbase4.apache.org/36577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 00:12:29,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 00:12:29,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:29,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 00:12:29,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35857] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 00:12:29,123 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 763) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:46401 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5205 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1276342510_1 at /127.0.0.1:58632 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:57100 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:41928 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-748149066_17 at /127.0.0.1:58674 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1950a9ad-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=492 (was 497), ProcessCount=185 (was 185), AvailableMemoryMB=911 (was 2007) 2023-07-19 00:12:29,123 WARN [Listener at jenkins-hbase4.apache.org/36577] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 00:12:29,123 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 00:12:29,134 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:12:29,245 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689725428835_0007_01_000001 is : 143 2023-07-19 00:12:34,428 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 00:12:43,260 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:12:57,372 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:12:57,373 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:12:57,486 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 00:12:57,497 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 00:12:57,498 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:12:57,507 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 00:12:57,612 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 00:12:57,612 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 00:12:57,612 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 00:12:57,612 INFO [Listener at jenkins-hbase4.apache.org/36577] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 00:12:57,612 DEBUG [Listener at jenkins-hbase4.apache.org/36577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d81a277 to 127.0.0.1:55216 2023-07-19 00:12:57,612 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,613 DEBUG [Listener at jenkins-hbase4.apache.org/36577] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 00:12:57,613 DEBUG [Listener at jenkins-hbase4.apache.org/36577] util.JVMClusterUtil(257): Found active master hash=1164614560, stopped=false 2023-07-19 00:12:57,614 DEBUG [Listener at jenkins-hbase4.apache.org/36577] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,614 DEBUG [Listener at jenkins-hbase4.apache.org/36577] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 00:12:57,614 INFO [Listener at jenkins-hbase4.apache.org/36577] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:12:57,615 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:12:57,615 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:12:57,615 INFO [Listener at jenkins-hbase4.apache.org/36577] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 00:12:57,615 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:12:57,615 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 00:12:57,615 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 00:12:57,615 DEBUG [Listener at jenkins-hbase4.apache.org/36577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4882e9a1 to 127.0.0.1:55216 2023-07-19 00:12:57,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:12:57,616 DEBUG [Listener at jenkins-hbase4.apache.org/36577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:12:57,616 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33821,1689725420836' ***** 2023-07-19 00:12:57,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:12:57,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 00:12:57,616 DEBUG [Listener at jenkins-hbase4.apache.org/36577] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,617 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:12:57,617 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36575,1689725420902' ***** 2023-07-19 00:12:57,617 DEBUG [Listener at jenkins-hbase4.apache.org/36577] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,617 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:12:57,617 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42753,1689725420945' ***** 2023-07-19 00:12:57,617 DEBUG [Listener at jenkins-hbase4.apache.org/36577] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,617 INFO [RS:0;jenkins-hbase4:33821] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:12:57,617 INFO [RS:1;jenkins-hbase4:36575] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:12:57,617 INFO [Listener at jenkins-hbase4.apache.org/36577] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 00:12:57,617 INFO [RS:1;jenkins-hbase4:36575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:12:57,617 INFO [RS:0;jenkins-hbase4:33821] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:12:57,617 INFO [RS:1;jenkins-hbase4:36575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:12:57,617 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:12:57,617 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:12:57,618 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(3305): Received CLOSE for 2a960486aff1fc768be04749de29033f 2023-07-19 00:12:57,617 INFO [RS:2;jenkins-hbase4:42753] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 00:12:57,617 INFO [RS:0;jenkins-hbase4:33821] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:12:57,618 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 00:12:57,618 INFO [RS:2;jenkins-hbase4:42753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 00:12:57,618 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(3305): Received CLOSE for 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:12:57,618 INFO [RS:2;jenkins-hbase4:42753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 00:12:57,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a960486aff1fc768be04749de29033f, disabling compactions & flushes 2023-07-19 00:12:57,619 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:57,618 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:57,620 DEBUG [RS:2;jenkins-hbase4:42753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a554aa1 to 127.0.0.1:55216 2023-07-19 00:12:57,620 DEBUG [RS:1;jenkins-hbase4:36575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0619b452 to 127.0.0.1:55216 2023-07-19 00:12:57,620 DEBUG [RS:2;jenkins-hbase4:42753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ac842ce638f7866b81da1d9042315ae, disabling compactions & flushes 2023-07-19 00:12:57,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:12:57,621 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42753,1689725420945; all regions closed. 2023-07-19 00:12:57,618 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:57,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:12:57,621 DEBUG [RS:0;jenkins-hbase4:33821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x714db376 to 127.0.0.1:55216 2023-07-19 00:12:57,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:12:57,620 DEBUG [RS:1;jenkins-hbase4:36575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:12:57,621 DEBUG [RS:0;jenkins-hbase4:33821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. after waiting 0 ms 2023-07-19 00:12:57,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. after waiting 0 ms 2023-07-19 00:12:57,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:12:57,623 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 00:12:57,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9ac842ce638f7866b81da1d9042315ae 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 00:12:57,624 INFO [RS:0;jenkins-hbase4:33821] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:12:57,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:12:57,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2a960486aff1fc768be04749de29033f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 00:12:57,624 INFO [RS:0;jenkins-hbase4:33821] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:12:57,624 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1478): Online Regions={2a960486aff1fc768be04749de29033f=hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f.} 2023-07-19 00:12:57,624 INFO [RS:0;jenkins-hbase4:33821] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:12:57,624 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 00:12:57,625 DEBUG [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1504): Waiting on 2a960486aff1fc768be04749de29033f 2023-07-19 00:12:57,628 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 00:12:57,628 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1478): Online Regions={9ac842ce638f7866b81da1d9042315ae=hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae., 1588230740=hbase:meta,,1.1588230740} 2023-07-19 00:12:57,628 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1504): Waiting on 1588230740, 9ac842ce638f7866b81da1d9042315ae 2023-07-19 00:12:57,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 00:12:57,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 00:12:57,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 00:12:57,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 00:12:57,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 00:12:57,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 00:12:57,651 DEBUG [RS:2;jenkins-hbase4:42753] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs 2023-07-19 00:12:57,651 INFO [RS:2;jenkins-hbase4:42753] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42753%2C1689725420945:(num 1689725423167) 2023-07-19 00:12:57,651 DEBUG [RS:2;jenkins-hbase4:42753] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,651 INFO [RS:2;jenkins-hbase4:42753] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:57,652 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:57,653 INFO [RS:2;jenkins-hbase4:42753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 00:12:57,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/.tmp/l/f2b9273259e04de58d866078097138dc 2023-07-19 00:12:57,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/.tmp/info/0520c3c6413647f9b0770106995331b6 2023-07-19 00:12:57,659 INFO [RS:2;jenkins-hbase4:42753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:12:57,659 INFO [RS:2;jenkins-hbase4:42753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:12:57,659 INFO [RS:2;jenkins-hbase4:42753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:12:57,659 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:12:57,661 INFO [RS:2;jenkins-hbase4:42753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42753 2023-07-19 00:12:57,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/info/111d19b57a8044b48e62a48146c1ffe7 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42753,1689725420945 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:57,667 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:57,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2b9273259e04de58d866078097138dc 2023-07-19 00:12:57,668 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:57,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/.tmp/l/f2b9273259e04de58d866078097138dc as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/l/f2b9273259e04de58d866078097138dc 2023-07-19 00:12:57,669 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42753,1689725420945] 2023-07-19 00:12:57,670 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42753,1689725420945; numProcessing=1 2023-07-19 00:12:57,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 111d19b57a8044b48e62a48146c1ffe7 2023-07-19 00:12:57,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/.tmp/info/0520c3c6413647f9b0770106995331b6 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/info/0520c3c6413647f9b0770106995331b6 2023-07-19 00:12:57,672 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42753,1689725420945 already deleted, retry=false 2023-07-19 00:12:57,672 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42753,1689725420945 expired; onlineServers=2 2023-07-19 00:12:57,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2b9273259e04de58d866078097138dc 2023-07-19 00:12:57,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/l/f2b9273259e04de58d866078097138dc, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 00:12:57,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9ac842ce638f7866b81da1d9042315ae in 58ms, sequenceid=18, compaction requested=false 2023-07-19 00:12:57,684 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:57,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/info/0520c3c6413647f9b0770106995331b6, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 00:12:57,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2a960486aff1fc768be04749de29033f in 62ms, sequenceid=6, compaction requested=false 2023-07-19 00:12:57,687 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:57,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/acl/9ac842ce638f7866b81da1d9042315ae/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 00:12:57,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/rep_barrier/2e6f4228914a460f8f3e36e25362de3f 2023-07-19 00:12:57,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/namespace/2a960486aff1fc768be04749de29033f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 00:12:57,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:12:57,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:12:57,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ac842ce638f7866b81da1d9042315ae: 2023-07-19 00:12:57,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a960486aff1fc768be04749de29033f: 2023-07-19 00:12:57,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689725424626.9ac842ce638f7866b81da1d9042315ae. 2023-07-19 00:12:57,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689725423741.2a960486aff1fc768be04749de29033f. 2023-07-19 00:12:57,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6f4228914a460f8f3e36e25362de3f 2023-07-19 00:12:57,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/table/436358b23170463e8d735a5b9e9d0493 2023-07-19 00:12:57,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 436358b23170463e8d735a5b9e9d0493 2023-07-19 00:12:57,762 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/info/111d19b57a8044b48e62a48146c1ffe7 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/info/111d19b57a8044b48e62a48146c1ffe7 2023-07-19 00:12:57,769 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:57,769 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:42753-0x1017aea3e690003, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:57,769 INFO [RS:2;jenkins-hbase4:42753] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42753,1689725420945; zookeeper connection closed. 2023-07-19 00:12:57,779 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ae28d65] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ae28d65 2023-07-19 00:12:57,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 111d19b57a8044b48e62a48146c1ffe7 2023-07-19 00:12:57,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/info/111d19b57a8044b48e62a48146c1ffe7, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 00:12:57,783 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/rep_barrier/2e6f4228914a460f8f3e36e25362de3f as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/rep_barrier/2e6f4228914a460f8f3e36e25362de3f 2023-07-19 00:12:57,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6f4228914a460f8f3e36e25362de3f 2023-07-19 00:12:57,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/rep_barrier/2e6f4228914a460f8f3e36e25362de3f, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 00:12:57,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/.tmp/table/436358b23170463e8d735a5b9e9d0493 as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/table/436358b23170463e8d735a5b9e9d0493 2023-07-19 00:12:57,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 436358b23170463e8d735a5b9e9d0493 2023-07-19 00:12:57,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/table/436358b23170463e8d735a5b9e9d0493, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 00:12:57,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 167ms, sequenceid=131, compaction requested=false 2023-07-19 00:12:57,828 DEBUG [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 00:12:57,834 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36575,1689725420902; all regions closed. 2023-07-19 00:12:57,844 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 00:12:57,844 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 00:12:57,844 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 00:12:57,844 DEBUG [RS:1;jenkins-hbase4:36575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs 2023-07-19 00:12:57,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 00:12:57,845 INFO [RS:1;jenkins-hbase4:36575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36575%2C1689725420902:(num 1689725423175) 2023-07-19 00:12:57,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 00:12:57,845 DEBUG [RS:1;jenkins-hbase4:36575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:57,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 00:12:57,846 INFO [RS:1;jenkins-hbase4:36575] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:57,846 INFO [RS:1;jenkins-hbase4:36575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 00:12:57,847 INFO [RS:1;jenkins-hbase4:36575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 00:12:57,847 INFO [RS:1;jenkins-hbase4:36575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 00:12:57,847 INFO [RS:1;jenkins-hbase4:36575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 00:12:57,847 INFO [RS:1;jenkins-hbase4:36575] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36575 2023-07-19 00:12:57,848 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:12:57,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:57,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:57,850 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36575,1689725420902 2023-07-19 00:12:57,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36575,1689725420902] 2023-07-19 00:12:57,850 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36575,1689725420902; numProcessing=2 2023-07-19 00:12:57,852 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36575,1689725420902 already deleted, retry=false 2023-07-19 00:12:57,852 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36575,1689725420902 expired; onlineServers=1 2023-07-19 00:12:57,952 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:57,952 INFO [RS:1;jenkins-hbase4:36575] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36575,1689725420902; zookeeper connection closed. 2023-07-19 00:12:57,952 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:36575-0x1017aea3e690002, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:57,952 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6e11f20] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6e11f20 2023-07-19 00:12:58,021 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 00:12:58,022 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 00:12:58,028 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33821,1689725420836; all regions closed. 2023-07-19 00:12:58,041 DEBUG [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs 2023-07-19 00:12:58,041 INFO [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33821%2C1689725420836.meta:.meta(num 1689725423319) 2023-07-19 00:12:58,046 DEBUG [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/oldWALs 2023-07-19 00:12:58,046 INFO [RS:0;jenkins-hbase4:33821] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33821%2C1689725420836:(num 1689725423164) 2023-07-19 00:12:58,046 DEBUG [RS:0;jenkins-hbase4:33821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:58,046 INFO [RS:0;jenkins-hbase4:33821] regionserver.LeaseManager(133): Closed leases 2023-07-19 00:12:58,047 INFO [RS:0;jenkins-hbase4:33821] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 00:12:58,047 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:12:58,048 INFO [RS:0;jenkins-hbase4:33821] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33821 2023-07-19 00:12:58,050 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33821,1689725420836 2023-07-19 00:12:58,050 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 00:12:58,051 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33821,1689725420836] 2023-07-19 00:12:58,051 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33821,1689725420836; numProcessing=3 2023-07-19 00:12:58,052 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33821,1689725420836 already deleted, retry=false 2023-07-19 00:12:58,052 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33821,1689725420836 expired; onlineServers=0 2023-07-19 00:12:58,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35857,1689725419330' ***** 2023-07-19 00:12:58,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 00:12:58,052 DEBUG [M:0;jenkins-hbase4:35857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@457919b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 00:12:58,052 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35857,1689725419330 2023-07-19 00:12:58,052 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35857,1689725419330; all regions closed. 2023-07-19 00:12:58,052 DEBUG [M:0;jenkins-hbase4:35857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 00:12:58,052 DEBUG [M:0;jenkins-hbase4:35857] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 00:12:58,053 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 00:12:58,053 DEBUG [M:0;jenkins-hbase4:35857] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 00:12:58,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422618] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689725422618,5,FailOnTimeoutGroup] 2023-07-19 00:12:58,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422623] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689725422623,5,FailOnTimeoutGroup] 2023-07-19 00:12:58,053 INFO [M:0;jenkins-hbase4:35857] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 00:12:58,053 INFO [M:0;jenkins-hbase4:35857] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 00:12:58,053 INFO [M:0;jenkins-hbase4:35857] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 00:12:58,053 DEBUG [M:0;jenkins-hbase4:35857] master.HMaster(1512): Stopping service threads 2023-07-19 00:12:58,053 INFO [M:0;jenkins-hbase4:35857] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 00:12:58,053 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 00:12:58,054 ERROR [M:0;jenkins-hbase4:35857] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-19 00:12:58,054 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 00:12:58,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 00:12:58,054 INFO [M:0;jenkins-hbase4:35857] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 00:12:58,054 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 00:12:58,055 DEBUG [M:0;jenkins-hbase4:35857] zookeeper.ZKUtil(398): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 00:12:58,055 WARN [M:0;jenkins-hbase4:35857] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 00:12:58,055 INFO [M:0;jenkins-hbase4:35857] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 00:12:58,055 INFO [M:0;jenkins-hbase4:35857] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 00:12:58,056 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 00:12:58,056 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:12:58,056 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:12:58,056 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 00:12:58,056 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:12:58,056 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.39 KB heapSize=449.61 KB 2023-07-19 00:12:58,068 INFO [M:0;jenkins-hbase4:35857] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.39 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b829265e4e04b3382cc24855252cffd 2023-07-19 00:12:58,072 INFO [M:0;jenkins-hbase4:35857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b829265e4e04b3382cc24855252cffd 2023-07-19 00:12:58,073 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b829265e4e04b3382cc24855252cffd as hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b829265e4e04b3382cc24855252cffd 2023-07-19 00:12:58,077 INFO [M:0;jenkins-hbase4:35857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b829265e4e04b3382cc24855252cffd 2023-07-19 00:12:58,077 INFO [M:0;jenkins-hbase4:35857] regionserver.HStore(1080): Added hdfs://localhost:39213/user/jenkins/test-data/d1d0ffd9-25a2-dcbc-8314-d31cff836b3b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b829265e4e04b3382cc24855252cffd, entries=119, sequenceid=899, filesize=28.5 K 2023-07-19 00:12:58,078 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegion(2948): Finished flush of dataSize ~373.39 KB/382352, heapSize ~449.59 KB/460384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-07-19 00:12:58,080 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 00:12:58,080 DEBUG [M:0;jenkins-hbase4:35857] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 00:12:58,083 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 00:12:58,083 INFO [M:0;jenkins-hbase4:35857] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 00:12:58,084 INFO [M:0;jenkins-hbase4:35857] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35857 2023-07-19 00:12:58,086 DEBUG [M:0;jenkins-hbase4:35857] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35857,1689725419330 already deleted, retry=false 2023-07-19 00:12:58,151 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:58,151 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): regionserver:33821-0x1017aea3e690001, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:58,151 INFO [RS:0;jenkins-hbase4:33821] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33821,1689725420836; zookeeper connection closed. 2023-07-19 00:12:58,151 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c7a581c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c7a581c 2023-07-19 00:12:58,152 INFO [Listener at jenkins-hbase4.apache.org/36577] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 00:12:58,251 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:58,251 DEBUG [Listener at localhost/46673-EventThread] zookeeper.ZKWatcher(600): master:35857-0x1017aea3e690000, quorum=127.0.0.1:55216, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 00:12:58,251 INFO [M:0;jenkins-hbase4:35857] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35857,1689725419330; zookeeper connection closed. 2023-07-19 00:12:58,253 WARN [Listener at jenkins-hbase4.apache.org/36577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:12:58,256 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:12:58,361 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:12:58,361 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-5220589-172.31.14.131-1689725415276 (Datanode Uuid a066e95d-e162-4931-842c-df3f032c8cab) service to localhost/127.0.0.1:39213 2023-07-19 00:12:58,363 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data5/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,364 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data6/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,366 WARN [Listener at jenkins-hbase4.apache.org/36577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:12:58,372 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:12:58,476 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:12:58,476 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-5220589-172.31.14.131-1689725415276 (Datanode Uuid 01df8280-e76c-4f12-a49c-6530628bd3ed) service to localhost/127.0.0.1:39213 2023-07-19 00:12:58,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data3/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data4/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,498 WARN [Listener at jenkins-hbase4.apache.org/36577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 00:12:58,501 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:12:58,604 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 00:12:58,604 WARN [BP-5220589-172.31.14.131-1689725415276 heartbeating to localhost/127.0.0.1:39213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-5220589-172.31.14.131-1689725415276 (Datanode Uuid 12693aab-ed53-42b5-b0f6-edae9da1e9b5) service to localhost/127.0.0.1:39213 2023-07-19 00:12:58,605 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data1/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,605 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ce2c8929-af0a-72bc-9eb8-c1460a1b5f1e/cluster_81c56309-8f1e-add2-08a8-c0db66e7175c/dfs/data/data2/current/BP-5220589-172.31.14.131-1689725415276] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 00:12:58,627 INFO [Listener at jenkins-hbase4.apache.org/36577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 00:12:58,752 INFO [Listener at jenkins-hbase4.apache.org/36577] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 00:12:58,842 INFO [Listener at jenkins-hbase4.apache.org/36577] hbase.HBaseTestingUtility(1293): Minicluster is down